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ABSTRACT 

A communications course was developed as a multimedia 
course using supplementary learning resources, such as audiotape 
cassettes and a series of televised lectures. To obtain information 
about the appropriateness and effectiveness of the methodology of th^e 
course, the research and development branch of the Ontario 
Educational Communications Authority commissioned an evaluation 
study. Section 1 of this report presents the results of that 
evaluation. Section 2 of the report presents an evaluation of 
another, followup course. The major results of the investigations 
conducted was to improve the courses for the following years and to 
recognize the need to continue the evaluation process. (HE) 
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INTRODUCTION 



Arts 100: Communications Is a communications course designed 
by Donald R. Gordon of the University of Waterloo. Originally, it was 
taught by Professor Gordon and others at the University of Waterloo with- 
out the aid of television; however, during the 1971-72 academic year, a 
series of televised lectures, featuring Professor Gordon as the lecturer, 
were used for the course Instead of the traditional live lectures. These 
televised lectures were produced and transmitted by The Ontario Educational 
Communications Authority (OECA) . In addition, the OECA and the University 
of Waterloo developed supplementary learning resources, including a set of 
audio-tape cassettes, making the course for the first time a multi-media 
learning experience. 

To obtain information about the appropriateness and effective- 
ness of the revised methodology in the Arts 100 course. The Research and 
Development Branch of the OECA commissioned an evaluation study of the 
course as it was designed and offered in the 1971-72 academic year. The 
investigators were Drs. Marvin Brown and Edward E. Ware of the University 
of Waterloo; Section I of this report presents the results of that 
evaluation. 

During the same year, 1971—72, the multl— media Arts 100 course 
was used as a basis for developing a communications course at Erlndale 
College, Communications lOOE . The Erlndale course was not offered in the 
way that the Arts 100 course was designed. However, because it 
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Incorporated some of the Arts 100 components, Including the televised lectures. 
It provided an opportunity for studying other possible uses of these 
components. Consequently, The Research and Development Branch of the OECA 
also conducted an evaluation of^ Communications lOOE for the 1971-72 year. 
The Project Officer for this latter study was Dr. Donald M. Keller and 
the findings of his study can be found In Section II. (Page 87) 

In Interpreting the findings of Dr. Keller^ s report, one must 
remember that the study was an evaluation of Communications lOOE, not Arts 100. 
Findings regarding the use of various Arts 100 components provide Insight Into 
the appropriateness or Inappropr lateness of these components In the course. 
Communications lOOE; they should not be used, however. In any assessment of 
the Arts 100 course per se. 

The major result of the Investigations conducted during the past 
year has been an improved Arts 100 course for the 1972-73 year. The course 
will be offered again at the University of Waterloo. In addition, a more 
definitive evaluation project has been designed. It Is obvious that on-going 
evaluation is a prerequisite if positive course evaluation is to be maximized. 



SECTION I 

EVALUATION OF ARTS 100: COMMUNICATIONS 
UNIVERSITY OF WATERLOO 
1971-72 



by 

Marvin Brcwn and Edward E. Ware 
University of Waterloo 
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ABSTRACT " 

This project sought to ovaluato tho of foots of Arts 100 on the 
students enrolled in it end on the nonstudents who viewed the weekly televiled 
lectures. Several questionnaires, a survey of attitudes toward the mass 
Mdia and a course exaaination were developed for this ipurpose. About half 
the students in the course coapleted the final c|uestionnaire. The part-time, 
mainly adult, itudmts rated the course very highly. The ratings of the full* 
tiM students were aoderately positive, loth groins gave poeittve evaluations 
of ttost of the coiurse consents the lectures, the text book» the lecture 
notes, the assigwients and the audio tq>es. Only the monthly seminars were 
negatively evaluated. 

The lecture material on the mass media was much better received 
than that on the senses. A considerable number of the students reported 
changes in their attitudes tonard the mass media^genefally in the directim 
of greater scepticism about thii Jiedia as sources of information. The examl* 
nation revealed that Arts 100 students were better able to deal with material 
about communications than were other university students. 

The reactions of a group of 80 volunteer nonstudent viewers were 
similar to those of the part-time students. This group, which was not necessarily 
typical of all viewers, watched the broadcasts regularly and Was quite enthusiastic 
about them. 
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AITS 100 

Tht Unlv«rtlty of Nattrloo, in co-operation with tha Ontario 

Educational CoMHinications AutKority (OECA), offarod Arts 100: Cowunicationt 

— A Coursa on tha Now Litaracy, during the 1971/72 acadaaic yaar. 1^^cording 

to tha coursa announcaaMnt 

Arts 100: Cowunicatioi^s is intandad to facilitata tha'tindar- 
staadini and usa of eont«qporary cc—rnitcattont Mdla. It 
•xplWB tha various kinds of ^foxaatlott wallatbla to aodam 
Ma throuiK his tonsas, and it eonaidtrs th« mlatteiiihip batwoMi 
sanaory pareaptlon and eoMunieation. Hm eourst iiieltt4»s saetions 
on tha aaas aadia (prints flUi, radio and talavltlon) , altamttivat 
to tha usa nadia, and languaga and logic. CoMMintcation is shown 
to bo an ordtaatratad procass involving tha siaultanaous usa of 
■any tachnlipias and devicas. Finally, avidonea is prosanted for 
and against tha proposition that convantional litaracy is now 

bain g raplacad by a new litaracy involv ing tha vari ous coaawmications 

, aadia. 

Tha course aada use of 30 weekly half-hour television broadcasts, a textbook 
(Professor Gordon's The New Literacy) , 12 audiotape cassettes, notes on the 
audio and videotapes, «onthly s»all group seninar aeetings, and a toll-free 
phone line between students and the course assistants. The students' course 
grades were based upon seven assignaents coapleted at the rate of roughly one 
per aonth during the acadeaic year. 

Although university course-enrolaent figures are iaprecise (Arts 
100 is no exception to that rule), at last count (March 27) there seened 
to be 317 students officially enrolled in the course.^ This nuaber aay be 

♦ 

too high since 14 students officially on the class list had not handed in 
any assigiaients by the end of the course. Of the 317, 201 (63.4%) were full- 
tiae students who took Arts 100 as part of their five or six course load. 
Aaong the full-tiae students were soae in all faculties of the University. 
About half of thea were in Arts, with sizeable nuabers in Matheaatics and 

♦ ^ 

*Tha Registrar's Office counted 322 official registrants on Daceaber 1, 1971 
for Provincial Grant purposes. We use the later figure of 317 provided by the 
Interf acuity Procraaaa loard, tha adainlstrative unit in charge of Arts 100. 
I/- Even this figure ^probably overastiaates the nuaber of students in the course u 



grades were sutaittad for only 303 
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Environmental Studies, a smaller number in Science and a few students in 
each of the other faculties. The other 116 students were part-time — 
109 having registered in the University specifically to take Arts 100. 
Of the 109 students taking only Arts 100, 75 lived outside the Kitchener- 
Waterloo area 48 in the Toronto area, 12 in Oshawa and IS in Hamilton. 

The course dropout rate was quite low. Although comparable 
figures are not available, the drop rate of approximately 12 (less than 
S%) does seem to be lower than other comparable courses (e.g.. Introductory 
Psychology and Sociology). 

It would seem that the course was quite successful in attracting 
full-time students. There was a substantial increase in its enrolment from 
135 in 1970/71. On the other hand, fewer part-time students then were origi- 
nally projected enrolled. The University, in its response to the draft report 
of the Wright Commission, stated that the part-time enrolment ••turned out to 
be one third of what had been estimated. •' Since we lack data for part-time 
enrolment in comparable courses, it is difficult to know what to make of 
the numbers. Further, the projected enrolment seems to have been more a guess 
^ than a well-researched projection. It appears fair to say that the 1971-72 
course enrolment could not be accurately projected. 

Since the television broadcasts were shown over channels 19 (Toronto) 
and 13 (Kitchener-Waterloo), there was also an audience of viewers who watched 
the telecasts but who were not enrolled in the course. The BW Fall survey 
of Channel 19 viewers^ (weeks of November 1-14) estimated 5100, 5700 and 7600 
viewers for the Tuesday, Thursday and Sunday broadcasts, respectively. In 
March the comparable figures were 7400, 8300 and 4000, suggesting an increase 

^These figures are projections based upon telephone interviews of fewer than 
1700 people (only 600 in the Toronto area). As such, they are imprecise and 
could involve substantial errors. They should be taken as very rough estimates 
only. 

er|c ^ ^ 
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viewers, a true/false "Content Hxamination*' based on the text and 
TV presentations, and a measure of attitudes toward the mass media 
("Mass Media Survey*'). Copies of these instruments are included in 
the Appendices and fnore detailed descriptions are given in the Results 
section of this leport. 

PARTICIP A NTS IN' STUDY 

Project participants were recruited in much the saiue mamier as 
they were last year: 

1 . Viewers 

An abbreviated version of last year's "spot" was run at the end 
of a number of televised lectures asking for volunteers to "fill out 
a couple of ^simple questionnaires* in return for which we'll send you 
materials to use in conjunction with the projjrams". The spots were 
run in two series. The first, from Octohor 29 through December 3, 1972, 
produced 30 volunteers. The second, from February 27 through March 18, 
1073, produced an additional 16 volunteers. 

In April, questionnaires and a free copy of The Ne w Litera cy were 
sont to these 46 volunteers; 11 of the first group and 13 of the 
second returned completed questionnaires. It is interesting that last 
year, a single series of "spots" produced 123 volunteers of whom 76 
were respondents at the end of the year. These figures suggest lower 
viewer "involvement" and are consistent with the apparent decrease 
in the si::e of the viewing audience noted later. 

2. Students 

Like last year, students were iskcd to participate in the evaluation 
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information. It also asked for the student *s educational background, his 
or her status as a student (i.e., whether full-time or part-time, etc.), 
and related questions. This sheet was sent to all students enrolled in 
the course. It was accompanied by a cover letter from Professor Gordon 
urging students to take part in the project and assuring them that individual 
responses would be kept confidential. Another cover letter from the investi- 
gators described the general purpose of the project and what the students 
would be asked to do. It stressed that responses would be anonymous and 
would be tied only to a project-related code number. An addressed postage- 
paid envelope was also provided. In all, 224 (70.7%) of the students returned 
completed forms. One hundred and ninety-three students returned completed 
forms in time to be included in the mid -year evaluation. The analysis of 
the demographic data (seo below) is based on these returns. The 70% return 
rate was a pleasant surprise in that we had anticipated about a 50% return. 

Weekly Activity Sheet 

We were also interested in the amount of time students spent on 
the various course-related activities. After considering several possible 
ways of obtaining such an index, we devised a log, called the **Weekly Activity 
Sheet'\ on which the students could record the time spent on each of the 
course activities (watching TV lecture, preparing assignments, reading, etc.) 
during a specified one-week period (see Appendix B) . We felt and experience 
confirmed that this part of the form would be easy to use and relatively 
unsusceptible to either faulty memory or deliberate distortion on the part 
of the students. We were also interested in the students* evaluations of 
each of the course activities. Since the mid-year and final evaluations 
dealt with relatively general reactions to, for example, the text and the 
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TV series, we thought it would be useful to obtain evaluations of specific 
broadcasts or chapters. On the back of the Weekly Activity Sheet the students 
were asked to indicate how valuable they found each activity engaged in 
during the week by circling the appropriate number on a seven -point rating 
scale running from "little or no value" (1) to "extremely worthwhile" (7). 

The students who had agreed to participate by returning a com- 
pleted General Information Sheet by November 15th (N«155) were divided into 
four groups. Each group was sent a Weekly Activity Sheet covering one of 
the weeks of November 15, 22, 29 or December 6. We originally planned to 
continue sending out the logs for 11 weeks starting January 3, 1972, so 
that each student would be surveyed about three times during the course. 

We soon discovered several serious difficulties with the Weekly 
Activity Sheet and, as a result, decided to discontinue its use. (1) Only 
108 students, 69.7% of those to whom the form had been sent, returned it. 
The comments on the forms returned indicated that some students resented 
completing this particulr form. Also, the return rate tended to be quite 
variable and generally to decrease from mailing to mailing (November 15 = 
90%, November 22 = 73%, November 29 » 46%, December 6 » 68%). (2) The 
students took a long time to return the forms, so that in many cases we 
could not be sure which week was being reported. For example, one return 
for the week of November 29th was received by us on February 9th. And for 
the December 6th mailing, only 7 returns were received within the 2 weeks 
of the mailing date (18 others were received later — several much later). 
(3) Most important, perhaps, was the indication that while the log section 
posed no problems, a number of students did not understand how to do the 
evaluative ratings of the weekly activities. These problems, coupled with 
the clear tendency for successive mailings of project materials to produce 

13 
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diminishing return rates (see below) led us to abandon our weekly logs. 
The measure of primary interest ~ the time spent in course-related 
activities could be obtained on the Mid-Year and Final Evaluation 
(^estionnaire without increasing the risk of closing respondents. 



Mid- Year Evaluation Questionnaires 

In order to obtain interim evaluations of Arts 100 from both the 
students and the nonstudent viewers, two three-page questionnaires were 
administered at about the halfway point of the course. The questionnaires 
were similar in content and format except that the face sheet of the non- 
student questionnaire asked for some of the same information as did the 
students' General Information Sheet (education, occupation, age, sex, etc.), 
as well as general information concemihg the viewing of the Arts 100 series 
(e.g., reasons for watching, what they thought they were getting out of the 
programmes so far, how regularly the broadcasts were viewed, whether they 
were seen in colour or black and white, alone or with others, etc.). In 
both questionnaires, the questions were mainly multiple choice, but con- 
siderable opportunity was provided for more open-ended responses. These 
responses clarified and elaborated upon the multiple-choice responses, and 
were very helpful in the development of the final evaluation questionnaires. 

Since the mid-year questioxmaires were very similar to those used at the 
4 

end of the course, it is not necessary to describe them in detail here. 

The student questionnaire was sent to the 193 students who had 
returned the General Information Sheet by January iSth. In all, 125 students 
(64.8%) returned completed questionnaires. The questionnaire for the non- 
students was sent to the 123 viewers who had volunteered earlier and 88 of 
them (71.5%) returned questionnaires. All nonstudent respondents were sent 

Q ^Copies and descriptions of the mid-year questionnaires, as well as analysis 
^j^Q and discussion of the responses are given in the interim report of this project. 

ilj'lliffllffll'n'il^n ^ 



a copy of the programme notes for the TV lectures as promised in the 
televised ''spots*' which had invited them to participate. In addition, 
every second respondent was sent a copy of Professor Gordon's course 
text The New Literacy . This was done to permit us to determine whether 
the addition of relevant materials would affect the viewers' final reactions 
to the series. 

The response rates from both the students and nonstudents 
illustrate a problem we had been concerned about from the outset of the 
study. With e^ch mailing fewer people continued to respond. A problem 
that had not been anticipated involved the extremely high mobility rate 
and consequent address changes of our student sample (this was much less 
true of the nonstudent sample, though even in this group there was a fair 
bit of moving). We know that some 15% of the students changed addresses 
during the academic year -- some several times. Undoubtedly there were 
other students whom we just lost track of. This may account for some of 
the progressive attritions. For these reasons we decided to discontinue 
all mailings until the final evaluation. 

Final Evaluation Questionnaires 

The most important part of the project involved the end-of-course 
questionnaires. An attempt was made to make the student and the nonstudent 
questionnaires short enough so that they could be completed in thirty minutes. 
Like the mid-year questionnaires » the format was mainly multiple-choice. 
A few questions asked for open-ended responses and there was room beside every 
question to clarify or elaborate upon the response checked. Each questionnaire 
had two parts: one concerning the evaluation of Arts 100, the other dealing 
with attitudes toward and use of several of the most popular mass media. 
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Student Questionnaire , The Student Evaluation Questionnaire 
(see Appendix C) had 29 questions and was five pages long. The 22 multiple- 
choice items covered general evaluations of the course as a whole (e.g., ^*To 
what extent has Arts 100 met your personal expectations?" almost completely 
to not at all ; "How would you rate Arts 100 overall?" — excellent to poor ; "Do 
you feel that the time devoted to Arts 100 was well spent?" — always to never) , 
as well as specific components of the course such as the book (**How worthwhile 
did you fine the book The New Literacy? " — extremely worthwhile to a waste of 
time) , the seminars and the assignments. Several questions dealt with the 
televised lectures (e.g.. "How understandable did you find the TV lectures?" 

extremely to not at all understandable) as well as specific aspects of the 
lectures (e.g., "What effect do you think the use of the puppet had on the 
TV lectures?" and "How do you feel about Professor Gordon *s use of Academic* 
or technical language?" too much , just about right or too little) . The 
open-ended questions focused on the telephone line (an area that the mid-year 
evaluajtion suggested should be explored), and asked about the amount of time 
spent on the course, any "nonacademic" effects of the course, its most and 
least valuably aspects and suggestions for improvement. 

Mass Media Survey . Attached to the student questionnaire was 
a two-page questionnaire (see Appendix D) concerned with the use of several 
of the most popular mass media (TV, radio, books, newspapers, magazines, and 
movies) as sources of information, and the respondent's opinions regarding 
the accuracy and objectivity of these media. The Mass Media Survey asked the 
respondent to indicate how accurate or biased he felt each medium in general 
was, and also how he felt about those parts of each he made use of (e.g., to 
TV in general as well as the specific TV programmes he watched). The question- 
naire also asked about any changes in use or attitudes during recent months. 

ERIC 
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Because of the problem with response rates already mentioned 
(p. 7) it was decided to have the students complete the questionnaire and 
the course exam (see below) in their seminar meetings. With Professor 
oordon's agreement all students m the course were asked to attend any 
one of 13 seminar sessions scheduled from March 21st to April 8th for this 
purpose. Since seminar attendance had been quite low, the students were 
told that those who completed the final evaluation questionnaire (whether 
or not they had completed previous items) would be given a free copy of 
Benjamin Singer* s "Communications in Canadian Society", a recently published 
paperback worth $4.75. The students were also told that if they could not 
attend any of the seminars they could complete the questionnaire by mail 
by returning a card to the project. In a]l, 84 students completed the final 
evaluation in the seminar groups (some three times the number that had been 
attending the same seminars) and another 61^ received and returned it by 
mail. Thus. 145 students, 45.7% of those apparently in the course (50.2% 
of those who had handed in at legist one assignment) made up our student 
sample. We feel that under the circumstances this was an excellent sample. 

Nonstudent Questionnaire . The questionnaire for the nonstudent 
viewers (see Appendix E) was comparable iu format and content to the student 
questionnaire. It asked many of the same questions about the televised lec- 
tures (e.g., "How would you rate Arts l(fO overall?") and also asked for com- 
parisons between Arts 100 and general TV fare as well as educational TV. 
This questionnaire was three pages long. The two-page Mass Media Survey 
was also attached. The combined questionnaire was sent to all 123 volunteers, 
whether they had completed the mid-year questionnaire or not, on April 3rd, 

^To permit the analyses and the issuing of this report on schedule, a cutoff 
date of May 12th was used. Returns received after this date have not been 
included. The return rates cited are, therefore, lower than the actual rates. 

17 
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the Monday of the final week of the Arts 100 series. A reminder letter 
was sent on April 28th. In all. 76 of the 88 (86%) viewers who had com* 
pleted the mid-year questionnaire and four of the 35 who had not (11%) 
responded, for a nonstudent viewer san^ple of 80. 

It is not clear why one third of the volunteers failed to complete 
the questionnaire* Part of the reason may involve the original delays (up 
to two months in a few cases, one month in most cases) in getting the mid-year 
questionnaire to the volunteers, although several letters were sent informing 
them that there would be such delays. A few of the names we received were 
sent in error. But we are unable to explain an attrition rate of this mag- 
nitude, given the fact that we were dealing with volunteers in the first 
instance. Perhaps some of them stopped watching Arts 100. (Also see footnote 
three, page three.) 

Course Examination 

In addition to any other effects of Arts 100, we were also interested 
in the acquisition and application of the course content. The seven course 
assignments did measure this, but we felt that the assignments were too general 
for our purposes. And since we wished to compare the knowledge about communi- 
cations of the Arts 100 students to others who had not taken the course, it 
was nece«><^ary to develop a relatively standardized instrument in effect, 
a course examination. 

The course material does not readily lend itself to "objective*' 
(multiple-choice) questions. Long essays are both unreliable and time con- 
suming to administer and grade. Therefore, we decided upon a short essay format 
for the exam. 

The exam was designed to measure the three major objectives of 
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the course as defined by Professor Gordon: (1) critical judgment of the 
mass media, (2) understanding the role and importance of sensory perception 
and (3) understanding the role and limitations of language in communication^ 
It was intended to be appropriate to rhe course, but also to permit those 
not in the course (see below) to answer the questions. That is, the exam 
had to be "fair" to both Arts 100 students and those not in the course. 

The final examination was developed by the course assistant^ in 
consultation with members of the evaluation project, Professor Gordon, and 
the OECA project officers. It was agreed by all concerned that the exam 
was a reasonable measure of mastery of the course content, and that it 
could also be done by people who had not taken Arts 100. Appendix F includes 
the exam and the scoring key. 

The examination was administered to all 84 students attending 
the final seminar sessions. It was done after the questionnaire in order 
to keep it from affecting; responses to the questionnaire. It was presented 
as part of the final evaluation procedure, scnne questions about communications, 
rather than as an "exam" per se. The students were assured that their answers 
would not be used in arriving at their final course grades. Forty-five minutes 
were allowed, although many students, finished in less time. 

The answers were graded by the course assistant, using a scoring 
scheme developed in conjunction with the project team. The scheme (see 
Appendix F) assigned specific numbers of points to various responses and was 
relatively objective. As a scoring check, the exams of 30 students, selected 
r-indomly from among the groups taking the exam, in proportion to their size, 
were scored independently by a member of the project team who had helped 
develop the system and was familiar with it. For the 30 exams, the two sets 
of total scores inter correlated .82 (.85, .83 and .69 for the three questions). 



Wo are indebted to Edith Rice for developing and grading the examination. 
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indicating high agreement between the two graders of the same questions, 
and more than acceptable reliability of the exam scoring* 

7 

Comparison Groups 

Examination * Since we had no measure of Arts 100 students* 
knowledge about communications before they took the course, it was important 
to compare what they knew at the end of it» as measured by the exam, with 
what other » comparable groups knew at the same point in time. Several 
comparison groups were used* One was a cJsss of 20 Introductory Psychology 
(Psychology 102) students (these students were roughly comparable to those 
taking Arts 100 in terms of distribution of academic years and programmes). 
A group of 39 students taking a Social Psychology extension course at Waterloo 
Lutheran University (Psychology 205L) was used because it contained many "adult" 
students, like the part-time students in Arts 100* In addition, we had access 
to a grade 13 class » and administered the exam to 18 grade 13 history students 
at Waterloo Collegiate. This was done to see how a grade 13 group would cw- 
pare with the university groups. In each case the exam was given during 
a regular class period, with 45 minutes being allowed. The exams were done 
anonymously. All those taking the exam were given a copy of The New Literacy 
afterwards . 

Mass Media Survey . For reasons similar to those outlined above, 
we needed comparison groups for the Mass Media Survey. Four such groups 
were obtained: A different Psychology 102 (N-20) class taught by one of 
the authors, the Psychology 20SL (N-SQ) class at Waterloo Lutheran, and 
two classes taking Psychological Statistics (52 in Psychology 283, 35 in 
Psychology 284). The survey was given at the end of each of these classes 

^We wish to thank John Shaw, Gary Reker, Dave Reid, Gary Griffin, John Dun- 
bar and Marvin Brown for making class time available to us. We also thank 
^ their students for being so helpful. 
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and took about five minutes to coaplete. These responses were all anonymous. 
Course Dropouts 

We had hoped to be able to determine the dropout rate in Arts 
100 and to compare it with that of other, comparable courses. We had also 
planned to contact those dropping the course to determine their reasons 
for doing so. A list of the twelve students who were thought to have 
dropped the course was obtained near the end of the course. We could not 
locate the phone numbers of six of them (and did not pursue them since 
we felt they would be disinclined to respond to our questions by mail) . 
Only four of the other six could be reached. One had registered in the 
course by accident and had corrected this by officially ^'dropping'* it. 
Two had fallen behind in their work, and the fourth, a nonstudent, had 
taken the course hoping it would provide techniques of media presentation. 
When he found that it was not doing this, he dropped the course, though 
he continued to watch the televised lectures. 

It is clear t^at our attempted analysis of the course dropouts 
was not successful. Indeed, since many students enrolled in the course 
well beyond the usual "add" period for other courses, only those who had 
already seen enough of it to know they were interested in it would have 
registered. The number who dropped was probably much lower than for com- 
parable courses, but the dropout rate is not a very meaningful index. In 
future it would be interesting to examine drop rates of those students 
preregistering for Arts 100 as compared to those preregi storing for other 
courses • 
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Results and Discussion 

Students Demographic Data 

The demographic data were obtained from the "General Information 
Shoet" which was, unfortunately, not completed by all the students in Arts 
100. The data below are based on the 193 completed returns received in 
time for the mid-year evaluation. However, this group includes 116 (80%) 
of the 145 students who took part in the final evaluation and is in most 
respects quite representative of the course as a whole. 

Table 1 shows that most students in this sample were full-time 
(n.0%). This figure ov^^r-represents the full-time proportion (63.4%) in 
the course as a whole. ..t also underestinates the number of students who 
registered primarily to take Arts 100. Tlds is probably because we recruited 
volunteers early in the term an4 close to 75 students (almost all part-time) 
had not yet registered by that time. As indicated above 80% of the students 
who completed the final evaluation questionnaire were from the original 
rj3 volunteers, and thero is no reason to suspect any important demographic 
differences between the groups, with two exceptions: The final evaluation 
group contained fewer full-time students (51%) and more adult students (28%). 
The students in the sample of 193, like all those In the course, were mainly 
from the Faculty of Arts, though there were some from all other faculties. 
Almost half of them were In first year, with sizeable nuabers in years 2 and 3. 
This "mix" of students Is just about wnat would be found in most introductory 
Arts courses. Since the two groups were probably, not comparable, in most cases 
separate analyses of the results have been carried out for full-time and part-time 
students. There were no relationships of Interest between any other demographic 
and any of the outcome variables. 
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Table 1 

Demographic Data -- Students Completing "General Infoznation 

Sheet" (N-193) 



Number 



Percent 



s;p 
21 
26 
31 
41 
51 



- 25 

- ^0 

- 40 

- I>0 

- hO 



Mean 

Median 

S.D. 



81 
66 
10 
19 
12 
4 

24.5 
21.0 
8.5 



42.2 
34.4 
5.2 
9.9 
6.3 
2.1 



••ex 



Male 
l-ema Ic 



110 
83 



57.0 
43.0 



Occupat io n 
Student 
Teacher 
Housewife 
Other 



139 
28 
9 
16 



72.4 
14.6 
4.7 
8.3 



H ighest level of education completed 
Grade 12 
Grade 13 

Comir.'ini '■y College 
Some .i'i< varsity 
Other 



9 
54 

27 
93 
10 



4.7 
28.0 
14.0 
48.2 

5.2 



(. ii rrenr student status 
ruU-time 
Part-'. ii-^e (degree) 
Non-dngree part-time 



137 
21 
35 



71.0 
10.9 
18.1 



Adult student? 
Yes 
No 



27 
166 



14.0 
86.0 
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Table 1 - (cont'd) 



Number 



Percent 



hnrolled primarily to take Arts 100? 

Yes 27 
No 166 



14.0 
86.0 



Faculty 
Arts 
Science 

Hnvironmental Studies 
Mathematics 

Physical Education Recreation 
Integrated Studies 
Engineering 



121 
11 
21 
24 
4 
3 
1 



65.4 
5.9 
11.4 
13.0 
2.2 
1.6 
O.S 



Year 



First 
Second 
Third 
Fourth 



7-6 
41 
31 
8 



48.7 
26.3 
19.9 
5.1 



Lecture s watched on 
Black and white TV 
Colour TV 
Both 



89 
76 
26 



46.6 
39.8 
13.6 



Seminars taken in : 
Waterloo 
Toronto 
Erindalc 
Oshawa 
Hamilton 



166 
15 
7 
3 
2 



86.0 
7.8 
3.6 
1.6 
1.0 



Not all students complete J all questions, 
slightly from variable to variable. 



The numbers of responses vary 
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Students* Course Expectations 

Table 2 sunmarizes the reasons given by the sample of 193 
students for taking Arts 100 and what they expected to get out of the 
course. As might be expected, many reasons for taking Arts 100 were 
given. These seem to divide into fi> o maot groups: Half the students 
cited an interest in the area of communications (27. S ^ 19.2 ^ 4.2%); 
some had heard that the course was interesting or worthwhile (23.8 ♦ 
6.7%); others cited its occupational relevance (11.4 ^ 12.4%); and a 
significant number cited convenience, the possibility of an easy credit 
and similar reasons (22. R ♦ 11.4%); finally, a few students cited personal 
growth oi development as the reason ^\.r taking the course. 

When asked what they hoped to ^et out of the course, the students 
gave somewhat similar answers: Two thirds stated they hoped for increased 
awareness and understanding and another 13% gave a related answer 
knowledge; 20% stated they hoped for a credit, and 12% mentioned personal 
development and satisfaction. % 

These reasons seem to be similar to those we imagine would be 
Kiven for taking most courses, although, lacking data, no direct comparisons 
are possible. 

Table 2 

Students* Reasons for Taking and Expectations of Arts 100 (N-193) 



No. Students % of Students 

Stating Responding 

Reasons for taking Arts UOQ 

Interested in communication S3 27.5 

Heard or thought it was interesting 46 23.8 
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Table 2 - .Cont'd) 



4- 



No. Students 
Stating 



% of Students 
Responding* 



Reasons for taking Arts AOO - contM 

Pasy option and credit; break frcr, 
Mthcr : >urses 

.ah i^p«>w ledge and umlt * ^ ' anting 
comntiu'i at ion and mass mr^dia 

further education and upgrading 
qualifications 

i;onvenience 

Help in present or future occupation 
Recommended by a fricni' 
Perso li] ^-rowth 

Intetf^s^t in educational tclevisic" 



43 

37 

24 
22 
22 
13 

.«/ 

8 



22. S 

19.2 

12.4 
11.4 
11.4 
6.7 
4.7 
4.2 



hope to >get out of the course 

Increased stimulation, understanding, 

awareness and sensitivitv 128 

rre^W* 39 

J li^rounii ^ » '.ic ; ^ : ' ^ K d ^ 36 

i^er or.ai satisfaction { de^'elop cnt 23 

Approviition for educntional television 6 

Other 2 



66.3 
20.2 
18.7 
11.9 
3.1 
1.0 



'^lany students gave more than one response. The figures, therefore, do 
'tOt sum to 100%. 
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Viewers' Demographic Data 

Table 3 gives some descriptive data on the 78 nonstudent 
volunteers who completed the viewers' mid-year evaluation questionnaire. 
The nonstudent respondents for the final questionnaire included four 
persons not in this group » but the two groups overlap so much in member- 
ship that they can be assumed to be the same. 

As might be expected the nonstudent group was somewhat older 
than the students. The nonstudents also varied much more in age» ranging 
from 13 to 69 years. There was a considerably greater percentage of males 
among the nonstudents. While there was a good deal of variability in edu-* 
cational background among the nonstudents, they were, on the whole, a highly 
educated group: Almost a third (28%) were university graduates, and 64% 
had some post -secondary education. Most (60%) of the nonstudent volunteers 
were engaged in other educational activities (e.g., university extension 
courses, general interest courses), ^'^ile some 75% indicated that they were 
engaged in other activities related to communications (e.g., reading, working 
on photography, discussion groups, performing). Occupationally, the nonstudent 
group (which included a tew students not formally enrolled in Arts 100) con- 
tained significant numbers of professionals, technicians and skilled trades- 
men, clerical workers, and people involved in television (performers and 
producers) . 

Most of the v'olufiteers watched the series on channel 19 (90%), on 
black and white TV (59%), alone (74%), and quite regularly (65% watched all 
or almost all broadcasts). They tended to be moderate TV watchers (just over 
two hours per day on average) and three quarters of them watched other "edu- 
cational" TV programmes. All these characteristics suggest that our nonstudent 
i^roup was not typical of the general population. Since they were volunteers. 



ERIC 



27 



- 20 - 



Table 3 

Demographic Data -- Nonstudent Viewers 
(78 Completing Mid-Year Evaluation Questionnaire) 



Question 



Number 



Percent 



Up to 20 
25 



21 
26 
51 
41 
51 



30 
40 
SO 
60 



Over 60 



12 
16 
15 
IS 
10 
5 
1 



16.2 
21.6 
20.3 
20.3 
13.5 
6.8 
1.4 



Mean 

Median 

S.D. 



33.0 
28.4 
13.6 



Male 
Female 



55 
23 



70.5 
29.5 



Occupation 

Student 16 

Teacher 11 

Housewife 11 

Clerical 9 

Professional 8 

Technician/Skilled trades 8 

TV-r/^^ Hod 4 

Saio-^ 3 

Other 8 



20.5 
14.1 
14.1 
11.5 
10.3 
10.3 
5.1 
3.8 
10.3 



I lighest 1 eve I of educatiop completed 



Up to grade 8 
Gradt>- 9-11 
Grade 12 
Grade 13 

Community College, etc. 
Some university 
University graduate 
Other 



2 
7 
12 
7 
9 
12 
22 
7 



2.6 

9.0 
15.4 

9.0 
11.5 
15.4 
28.2 

9.0 



". her c Ji.ca iional activiu - - . 

Yes ~ 47 
No 31 



60.3 
39.7 



28 



- 21 - 



Table 3 - (Cont'd) 



Question 



Number 



Percent 



Other activities related to 
communications? 

Yes 

No 



58- 
18 



76. 
23. 



How did you hear about the programme " 
TV listings 20 
TV advertisement IS 
Newspaper 17 
Friend 9 
Other 14 



25.6 
23.1 
21.8 
11.5 
17.9 



What channel do you watch on? 
19 UllF 
19 Cable 
13 VHF 
13 Cable 

Do you watch on : 

Black and white TV 

Colour TV 

Both 

Alone or with others? 
Alone 
Other*; 
Both 

1 l ow regularly do you watch ? 
Every week 
Miss occasional one 
3 out of 4 weeks 
Half of them 
Less than half 

Time spent watching TV 
Mean 
S.D. 

Katch other "educationa l" TV? 
Yes 
No 

Occasionally 



39 
31 
1 
7 



46 

29 
3 



58 
17 
3 



31 
19 
12 
9 
6 



128.4 minutes/day 
87.4 



58 
9 
10 



50.0 
39.7 
1.3 
9.0 



59.0 
37.2 
3.8 



74.4 
21.8 
3.8 



40.3 
24.7 
15.6 
11.7 
7.8 



75.3 
11.7 
13.0 



^Some respondents failed lo answer the odd question; so the numbers of 
responses vary a little from question to question. 
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they were probably also not typical of the whole Arts 100 viewing audience. 
We cannot determine this» so it must simply be recognized that our sample 
of viewers may be highly select. 

' 1 ' . ^1} ogramme Expect a tions 

The nonstudents provided a variety of reasons for viewing Arts 
I'^u, inchuling particular interest in the mass media^ relevance to occu- 
pation and enjoyment (see Table 4). ihe largest proportion of viewers expressed 
a -oacern with the mass media either through general interest or through 
thtMV own work. In statxn>i what they had hoped to obtain (in retrospect) 
ga\ -tnswors quite snPilar t:o tn^^^e lited as the reasons for viewing. 
I lie Item ubking what they were getting; so far suggests that the programmes 
were succesiful in meetijig their expeotatons and that this occurred fairly 
early in the series. This result was to have been expected since these 
volunteers were the viewers who had decided to continue watching the 
programmes and this decision would only have been made if Arts 100 was 
lar^:ely lui-.lmg their ex ■)ei*t ations . 

^'^'^"^ \JL ^'^ ' i ty Sheet 

iJ.e Weekly A,.ti»ity Siieet. included as Appendix B, was sent 
( tor roi.r weeks (November 15, 22, 29 and December 6) to a different 
^Moup or students each wecK . Results from this questionnaire are presented 
I. !al>l. luta fron* 0\ our **.'eeh have been combined into a single 
..c;ly>i.. au-i. in addition i iti* ; of the notes on different lectures, 

!ifferei5t aiulio tapes, and various « luipters of the text have been collapsed 
isto oxeijM ratings for the lecture.^, tapes and the , text respectively for 
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Table 4 

Viewers* Reasons for Watching Broadcasts, etc. (N»78) 



No. Viewers 
Stating 



% of Viewers 
Responding^ 



R easons fo r w atching broadcas ts 

Interest in communication and mass ir, ^^lia 48 

Further education/relevance to occup;w ion 22 

Increased knowledge; awareness; int. Mec- 

tual stimulation 15 

linjoyment; entertainment 10 

Self-enJ ightenraent; self-improvement 4 

Other 8 

Hope to get out of the br o adcas t s 

Factual knowledge; understanding; a., '"enoss 48 

Fresh viewpoint; new ideas 15 

Se 1 f -en 1 ightenmen t ; self- improvement 8 

^•njoyment; entertainment; •stimulation 5 

Menar:i« -n for further ' ati >n 4 

Other 5 

fier ' ing oui (.^ the broadca sts ^ o f ar^ 

l*actual knowledge; understanding; awareness 48 

Fresh viewpoint; new ideas 15 

hnjoymcnt; entertainment; ^ simulation 9 

*-.jlf -onl- ^iuenment ; sfif ;pro\?men? 9 

Other 9 



61.5 
28.2 

19.2 
12.8 
5.1 
10.3 

61.5 
19.2 
10.3 
6.4 
5.1 
6.4 

61.5 
19.5 
11.5 
11.5 
11.5 
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^tiny viewers gave more than one response, so the figures sum to more than 100%. 
These responses were given at about the halfway point of the series. 
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each student. Detailed analyses for particular chapters or tapes involve 
sample sizes too small to be reliable. The items in Part III of the Weekly 
Activity Sheet, involving evaluation of assignments and seminars, were 
inappropriately responded to by some ^tudeats (see page 5) and have been 
left out of the table. 

The ratings in Table 5 refer to the students' estimates of the 
value of each activity on a seven-point scale from "Little or No Value" 
(1) to "Extremely Worthwhile" (7), with the intervening points (2-6) not 
labelled. Fhus, a rating of 4 rcpre^onts a neutral position. On this 
basis mbsr. of the course components were seen to be of some value with 
the unassigned related readings (5.3Jj am^ other activities (5.47) seen 
as most W)rthwhile. However, only abo»it a third of the students were 
engaged ii those voluntary activities during the weeks sampled. Since 
these activities were optional one might expect them to be rated as 
worthwhile. Only the post-lecture, pnone-in procedure received a nega- 
tive rati ig (3.11). It appears that this feedback procedure was not 
serving a particularly useful purpose and in fact, was not being used 

of the students reporteci phoning As well, the notes on the 

a'lJio tap/s r(^ceived onl; slightly j^osi-ive rating. Here too, only 
one third of the students i -sported usiiig the audio tape or the notes. 
I^hf* aiffercnt components ot »he oursv are discussed in greater detail 
i-:iter. 

!t is interesting that 71. ^% of the students reported attending 
a seminar during this period. Since ] -iter attendance was substantially 
: i* oars that st».«''nt'> i-dtic);;> .iitended the seminars, but stopped 
coing because they did not t.nd hem .-^rthwhile. This point is considered 

This document was processed for the ERIC Document Reproduction Service 
by the ERIC Clearinghouse at Stanford. We are aware that some pages probably 
will not be readable in microfiche or in Hardcopy form. However, this is the best 
Q available copy, and we feel that the document should not be withheld from 3 3 

interested readers on the basis of these unreadable pages alone. 
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at length later. 

Table 5 also indicates the time spent on the course-related 
activities during the four week period. There was considerable variability 
^•^ the time spent on the course by d)./er«'at students. The major consumer 
ol time wa?. the assignments. The avo: \ge for all course components was 
just over seven hours per week (430.7 minutes), but the standard deviation 
was five and one half hours (330.7 minutes). This finding is consistent 
with the comments of the students: ^ reported spending almost no 
time on the course, others reported a onsiderable amount of time spent. 

The weekly Activity Sheet «iso showed that 67% of the students 
wi'ched tne televised lecture once, ' watched it twice, and S% three or 
more times per week. Tho comments confimi that the repeated broadcasts 
of the same lectures appears to he useful to many of the students. 

Finally a few (12-14%) of the students reported picture and/or 
sound reception that was not noraal, l-it these slight distortions in 
reception did not affect the evaluation of the TV lectures. 

Miilj-Year iA'ul uation Ques( ionnaire s 

1. Students . k'\sults of ♦he mid-year evaluation for the 109 
rc^isteri^i students who ro» rrned com^ '.^ed questionnaires in time to be 
included ai summarized m iable 6. Ihe questionnaire used was very 

imJIar » > »he final evaluation <iuest^onnaire (See appendix C and p^ 8 
• this i^^port). The first 14 itea'^ ^1 S alternatives per item and 
w-rc scored from 1 throu?J> with S representing the most positive 
position and a value of 3 ■'ipresontiT : a somewhat neutral position. In 
general, at about the haltv.a*' point the course, there was a positive 
feeling that the course was meeting tl-o students* personal expectations 
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and its ovm stated goals. Overall, the first half of Arts 100 was rated 
between good and very good and a little above average when conpared with 

other full courses the students were taking. 

« 

Arts 100 was rated as inteicsting (3.41) , intellectually 
stimulating (3.29), and being worth the time spent on it (3.79) • The 
different components of the course, TV lectures, text, assignments, etc., 
were all seen as worthwhile with the notes on the lectures receiving 
the highest rating. The exception here was the monthly seminars which 
received a rating of only 2.55. 

A high percentage (631>) ot the students felt that, in addition 
to coiirsic content, the f jr<;t half of Arts 100 had already influenced 
their behaviour in some way that it hac resulted in increased awareness, 
a different manner of thinking, greater scepticism, etc- on their part* 

On the mid-yesir questionnaire the students reported spending 
an average of three hours on the course. (Most of them felt that this 
was about the same time as was being spent on other courses.) However, 
on the Weekly Activity Sheet the stucji nts reported an average of 7 hours 
on the course more than twice as mM hi The two sets of time estimates 
arc significantly correlate.* (r».45, -68, p<.001), but the agreement 
is not ve^y liigh. We are t'nable to f lly explain the discrepancy (but 
sec p. 21 j, and are inclined to accepi the responses to question 16(B) 
as being the most accurate* For most students Arts 100 was no more time- 
. uisuming »aan their othor courses an. for almost half the students it 
wa5 less t^me-consuming. 

rhe mid-year qur srionnaiir also asked the students to indicate 
what they had found to be the most-ano least-valuable aspects of the course. 
In order of frequency, the most vaiuahie aspects were seen to be: TV 
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lectures (18\), assignments (16\) , OECA workshop (10%), convenience 
(10%), The New Literacy (9%), the lecture notes (7%), feedback from 
Professor Gordon (7%), the audio tapes (6%) and the outside readings 
(4%) . More general aspects of the c lurse were also mentioned: in- 
creased awareness and understanding ..10%), opportunity for self- 
evaluation (10%), and individual freedom in learning (6%). 

Least valuable were seen tn be the seminars (32%), the 
TV lectures (11%), audio tapes (10%), .^ss3gnments (8%), the Material 
on the senses (6%) and the hot line The lack of personal contact 

was mentioned as least vnluable by 7\ of the students. 

As often happens with such evaluations things that some students 
saw as most valuable, others saw as least valuable. By and large, though, 
these data support the evaluative ratings On the negative side two 
things stood out. First, fully a third o;' the students said that tho 
seminars ^rere the least valuable part of he course. Second, a number 
of students mentioned tho impersonal natuie of the course. 

Table 6 also presents somt^ interesting differences between 
the reactions of the ful' H»ne and p. rt-tjmc students. The part-time 
*^tudents gave higher rat n-. for all item';> statistically significant 
tiifferenccs in all but thrre cases. the comparable items the part-time 
students gave ratings quite similar t( those of the nonstudent viewers. 
On the miJ-year evaluation, then, Arts 100 was much batter received by the 
part-time students (and the nonstudent viewers) than by the full-time stu- 
dents. This difference was not due to the fact that the viewers and part- 
ti.ne students, who were oMcr and in..r ma. tire, were in general more appreci- 
ative of university courses since the part-time students rated Arts 100 
as "better than most** when compared with other courses they were taking 
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or had. taken. 

2. Nonstudent Viewers > The mi'd-year evaluation data from 
the 78 nonstudent viewers of Arts 100 appear in Table 7, This group 
rated the first half ot Arts 100 as .ary nood (4.01). When coiqpared 
with other general TV fare and "educational" television, Arts 100 was 
considered better than most. It was rated as quite interesting, quite 
informative, and quite i iteliectuall * stimulating. About 63% of the 
nonstudent viewers statel that the ccirse has influenced their behaviour 
in terms of increased awareness, gre;iier scepticism, etc. The responses 
to this item were very similar to tho^e o<* the students. 



Table- 7 

NonscuUcnts^ Mid -tear Evaluation 



a b 
Question N Mean S.D. 



14. How would you rate Arts 100 

oveiall? 78 4.01 0.69 

15. How Iocs it compare wiMi 

othc' TV programmes' '6 4.15 0.86 

16. How dc:^s it compare v,ith 

other ''educationar' Tv? 72 4.11 0.85 

17. How interesting? 78 3.99 0.76 

18. How informative? 72 3.99 0.74 

19. How intellectually stimu- 

lating? 74 3.85 0.87 

20. Any effect? Yes 45 (6^.4%) 

No ?6 (36.6%) 



^These are abbreviated ver- ions of iht^ act>ial questions asked, 
''some viewers did not answer all questions. 
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Couients on the open-ended questions concerning viewers* 
opinions about nost and least valuable aspects of Arts 100 fall readily 
into two large categories: (1) general statements about the course, and 

>peci ^ic cements referring to p<.i Ic; ur components or aspects of 
It. Almo t half the viev^ers cited as *nost valuable the information, 
increased awareness and understanding, anc intellectual stimulation 
provided by the course. These outcomcr- were similar to the reasons for 
watching and expectationf discussed earlier and suggests that tha course 
wc'iN meAtiiig the wishes of this group < f viewers. Thare were very few 
g<*neral comments regardii.g the least valuable aspects of the course. As 
w'*th the students, lack ( f personal c . tai t was mentioned by 6% of the 
group and another 4% fell that too mm h mtterial was covered. 

Among the specific comment.^ t the puppet received support as 
both the most (10%) and also the least valuable (19%) aspect. The most 
common positive statement concerned the use of film clips and aids (23% 
found this most valuable, although round this aspect least valuable). 
On the ne/acive side, 15^ were critical o* the use of academic language. 
Both of these items appeired as specr ic items on the final evaluation 
questionnaire » and are disc issed agair> later. 

Table 6 shows the responses of students and nonstudents to 
tour items trom the mid-ye;«r evaluation questionnaires which were com- 
parable <M the-threc evaluitive itei^^ the nonstudents were clearly more 
positive aivl less variable m thoir r.^iings than the full-time students. 
The nonstudents* reactions were quite *;imilar to these of the part-time 
students. For the item concerning behavioural effects of the course the 
results of the nonstudents ?»nd ail s^ i^ent^ were almost identical, with 
a high percentage responding yes in both groups. 
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In sunnary, then, the first half of the course and most of 
its components were moderately well-received by the students and very 
well-received by the non student volunteers. Among the students, those 
who were part-time rated the course »> t:te** than did the full-time. The 
ratings of the part-timers were very similar to those of the nonstudent 
viewers. The ratings of these older and perhaps more mature groups, 
part-time students and nonstudent vit?wers, constitute very good interim 
reviews for Arts 100. The reactions of the full-time students, while 
on the positive side, suggested that there is more room for improvement. 

I i nal Evnluation Questio ma ire 

1. Students . As stated j^revi msly about one-half of the 
students in the course took part in the f\nal evaluation (N"145). The results 
of the Final Evaluation Questionnaire for students are given in Table 8. The 
responses for all students as well as a breakdown for full-time and part- 
time students are included. As at m^i-yeir, the part-time students gave 
higher evaluations that did the full time students. To place these ratings 
in perspective the mean rating tor 3'"» Psychology Department courses are 
y^iven in Table 8 for four comparable items. In each case the Psychology 
ratings are higher than those of the full-time, but lower than those of 
the part-time Arts 100 students' ratings. In fact, the part-time students' 
rating:* .ir^- comparable to the ratings of the top courses in Psychology) while 
tUv full tiNj students woin I clfari> uinc** Arts 100 in the lower half of the 
distribution of Psychology :ourses. v problem interpreting this comparison 
results from the fact that these 30 Psychology courses cannot be considered 
us a representative sample of Arts Fi ulty courses. They are probably among 
the better courses in the Arts Faculty. (Psychology courses at the University 
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of Waterloo tend to have a good reputation among the students.) 

Table 8 also includes nonstudent viewers' ratings for several 
comparable items. (Complete results for nonstudents' final evaluations 
are in Table 10.) In genernl , the viewer? • were not significantly dif- 
ferent f r^m the ratings "»f nil student^ (full- and part-time combined). 
However, if we look at the general evaluative items (questions 3, 4, 5, 
8, 9), in each case the nonstudents' mean is closer to the part-time 
than the full-time students. Thus, both the part-time students and the 
nonstudent viewers were more enthusiastic about Arts 100 than were the 
full-time students, whose ratings were moderately positive. 

\gain, the on y Nearly n^ ntive aspect was the seminars, al- 
though tht* ;>art-time stucient:> did giv^ rhcm a rating of "worthwhile". 
Clearly, this aspect of the course requires considerable reworking. The 
comments on this item shed some light on the problem. There was apparently 
considerable variability in the performance of different seminar leaders. 
Comments ranged from "no direction tc )r from the seminar leader" to "leader 
was most helpful". Also several comn'<»nts suggest a desire for more structure 
in the *^et «>ars. A briet' iining pr ramme for seminar leaders and some 
degree of direction as to what might be dealt with in particular seminars would 
help. Experiences like the OECA workshop, which was extremely well received, 
might replace some of the ^^minars. B<v5ides weaknesses in the seminars them- 
sv]ves, several administrat -v e difficulties interfered with their operation. 
Problems w^jc encountered : schcdu) r.fe rooms for the seminars, and several times 
,^^u.l-nts arrived to find the rooms ^ ^ed Projectors and audio-visual personnel 
wore not always available when needed. These problems may well have played 
a part in "turning off*' the full-time students. The data do not suggest doing 
away with the seminars. Many student expressed a need for "personal 
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contact" and others -- part-timers especially -- did find the seminars 
useful. 

The only other aspect of questionable worth was the audio 
tapes. Overall, they were rated as adequate, but several comments 
suggest that the-tapes on the assignments were worthwhile, while the others 
were of little value. 

The other specific components (text, TV lectures, lecture 
notes, et-. » were quite well received by nhe students and the comments 
made renec- these high ratings, Se. ->al comments on the assignments 
referred to them as challenging, difficult or time-consunfing. This was 
meant as praise since the students seemed to feel that much was learned 
from the assignments . The question about the puppet generated a large 
number of comments ranging from 'Insulting to my intelligence" to "very, 
very effective" with more of the comments in the latter category. "I 
must admit that Thomas helped by freq:itntiy asking just what was on my 
mind" represents the content of severni of the comments and explains 
the high rating received. 

The amount of material covered in the lectures and the amount 
of time Professor Gordon was on camera seemed about right to the students, 
''here was too much "academic * langua^j according to a sizeable number of 
s'udcnts, pircicularly full time stud-nts It is interesting that the 
i jii tiiuc- students who were ordinarily much more exposed to academic 
language than the part-time or nonstndents should have complained of this. 
Perhaps they expected Arts 100 to be different- In any event, the comments 
here were quite varied r^ingmg from "sometimes it seemed like too much 
jargon" to "it stimulated me and made me sharpen my own language". 

The difficulty with the "hot line" was simply that most students 
did not use it. The comments indicate that they felt no need to. Most 
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of those who did phone in felt their needs were met. Accessibility 
of reading materials appeared to be a problem for a large number of 
part-time students --no doubt those living outside the Kitchener- 
Waterloo area. It should be relatively simple to solve this problem 
through arrangements with local public libraries. 

A large proportion of the students reported that Arts 100 
had an effect on them. In general, they felt an increased awareness 
and a more critical view of the mass media. 

The part-time students tended to put more time into Arts 
100 (roughly 4 hours/week) than the full-rime students (about 2 hours/ 
week), many of whom found Arts 100 less time-consuming than their other 
courses. It is likely that the part-time students were more highly 
motivated in Arts 100, consequently spent more time and effort and got 
more from the course. Their higher evaluations and the fact that the 
course grades were significantly higher for part-time than for full- 
time students support this interpretation. The time spent by the two 
groups might also account for some of the discrepancy between the Weekly 
Activity Sheet and the Mid-Year Questionnaire results noted earlier: 
Part-time students made up 31.5% of sample and only 26.5% of the Mid-Year 
sample. 

The comments generated by the open-ended items on most and 
least valuable aspects of the course are .summarized in Table 9. As 
with the mid-year evaluation, these have been broken into general and 
specific comments. The most valuable general aspects mainly involved 
increased awareness of the mass media, information and intellectual 
stimulation, and self-evaluation. The most valuable specific aspects 
tended to be those components (assignments, TV lectures, text, workshop. 
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etc.) which received high ratings on the objective items. The number 
of students indicating least valuable general aspects was too small to 
place any interpretation other than that there were very few general 
complaints about Arts 100. The seminars were again the leading speci- 
fic complaint. 

Finally, a number of studeats were especially pleased with 
Professor Gordon's comments on their assignments and his prompt replies 
to their letters. 

2. Nonstudent Viewers . The final evaluation results for 
the nonstudent viewers (N«80) are presented in Table 10. As stated 
earlier for the questions that were comparable the nonstudents* ratings 
were similar to the part-time students and somewhat higher than those 
of the full-time students. Over 60% of the nonstudents stated that they 
watched 7S% or more of the broadcasts and only 17.5% viewed less than 
half. This group, then/ pretty well stayed with the series. Their evalu- 
ative ratings are all quite high, including comparisons with TV in general 
and "educational'* TV. These ratings are summarized by comments like *Very 
well planned -- thought -provoking conclusions*' and *'of consistently high 
quality throughout the series'*. The nonstudents also appeared comfortable 
with the amount of material, the use of **academic" language, and the amount 
of time Professor Gordon was on camera. Again the puppet received many com- 
ments covering a wide range. Most of them were quite positive like "was 
fantastic idea" and "many of his questions were my own", but a few viewers 
were quite annoyed or insulted by the puppet and called it "babyish", "de- 
humanizing", and "too cutely 
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Table 10 

Nonstudents * Final Evaluation Results 



Question 



Niimber 



Percent 



1. How regularly did you watch the 
broadcasts? 

(a) every week 

(b) missed occasional one 

(c) about 3 weeks out of 4 

(d) roughly half of them 

(e) less than half of them 



17 
22 
11 
16 
14 



21.2% 
27.5% 
13.7% 
20.0% 
17.5% 



N 



2. How would you rate Arts 100 overall? 79 

3. How does it compare with other TV 
programmes? 77 

4. How does it compare with other 
"educational" TV? 76 

5. Would you recomnend Arts 100 to 



Mean 



3.98 
4.22 
4.24 



S.D, 



0.72 
0.72 
0.69 





a friend? 


78 


4.42 


0.70 


6. 


How interesting? 


80 


3.91 


0.70 


7. 


How infoimative? 


79 


3.96 


0.65 


8. 


How intellectually stimulating? 


79 


3.99 


0.71 


9. 


How clear were the presentations? 


79 


3.75 


0.81 


11. 


How effective was use of puppet? 


78 


3.87 


1.28 


14. 


How effective were illustrative 
materials? 


79 


4.52 


0.81 



10. How do you feel about the amount 
of material covered? 



Too much 11 (14.5%) 
About right 54 (71.1%) 
Too little 11 (14.5%) 
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rable 10 - (ContM) 



Question Number Percent 



12. 


How do you feel about the 


Too much 


12 


AS. 6 




use of "academic" iHnguage? 


About right 


63 


81.8 






Too little 


2 


2.6 


13. 


How do you feei about the 


Too much 


19 


24.1 




amount of time Prof, was 


About right 


56 


70.9 




on camera? 


Too little 


4 


5.1 


IS. 


Any effect? 


Yes 


55 


72.4 






No 


21 


27.6 


18. 


Did /oxi find the broadcast 


Yes 


58 


74.4 




time; convenient? 


No 


20 


25.6 



These ar? abbreviated versions of the questions asked, slightly 
rearrang<>d for tabular presentations. Artual question.) are in 
Appendix E. 

A large proportion (72%) stated that Arts 100 had an effect 
on them. Their comments were similar to those of the students, suggesting 
that most of the effect has been in gaining insight, more critical attitudes 
toward and more concern with the mas< media, as well as an increased 
avidrcness of and concern with the accuracy of what they thought , heard 
or apprehended. 

The most valuable general aspects of the programmes (Table 11) 
were also seen as increased awareness of the media, intellectual stimulation, 
and self -enlightenment. The most and least valuable specific aspects and 
the least valuable general aspects were responded to by too few nonstudents 
to draw any useful conclusions except that the great majority of nonstudents 
cited (and presumably found) no least valuable aspects. 
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Since half of th« nonstudent viewers had been provided with 
only the lecture notes and the other half with both the lecture notes 
and the text, The New Literacy , a comparison of their responses to the 
evaluative items was aade. The two groups were alaost identical in their 
ratings. The addition of Tlie New Literacy did not affect viewers' ratings 
of the series. 

Change Frow Mid-Year^^to^inal Evaluation 

1. Students . Table 12 presents the analysis of changes in 
students' responses from the mid-year to the final evaluation for those 
items and people in common. Table 13 gives the same data for the non- 
student viewers. Positive means represent an increase from mid-year 

to final evaluation. Mo«t of the students' ratings were more positive 
at the end of the course than at the middle. There were significant 
changes for overall course "rating, recommendation to a friend, stimu- 
lation of intellectual curiosity and worth of lecture notes for all 
students. The only significant decrease in evaluation for students con- 
cerned the seminars, indicating that what was already the weakest com- 
ponent in the Arts 100 package became even worse as the year progressed. 
The tendency for most items to increase in evaluation from mid-year 
to the end of the course may be explained by several comments which sug- 
gested that the later material on the mass media tended to be much more 
interesting and relevant in the students' opinion than the earlier material 
on the brain and the senses. 

2. Nonstudent Viewers . There were no significant changes in 
evaluative items for the nonstudents. There was a small but significant 
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Table 13 

Changes* from Mid-Year to Final Evaluation (Viewers) 



0*:; no; 



Change 



1 


flow regularly do you watch broadcasts? 


Mean 


- .699 






S.E. 


.108 






N 


73 


I 


How would you rate Arts 100 overall? 


Mean 


-.081 






S.E. 


.076 






N 


74 




t!ow\ you rate A t JOO in k 


Mean 


.014 




parif»')n with other rrogrammes'^ 


S.E. 


.079 






N 


71 


4. 


How would you rate Arts 100 in coip- 


Mean 


.116 




parison with '*educat:^onal" P/? 


S.E. 


.091 






N 


69 


r>. 


How interesting was programme? 


Mean 


-.068 






S.E. 


.087 






N 


74 


6. 


How informative was programme? 


Mean 


-.114 






S.E. 


.078 






N 


70 


7 , 


Hdw t ntcllcctually stimulating d} : 


Mean 


.114 




you find the programnes? 


S.E. 


.088 






N 


70 



Positive change means morv positive ^'valuation at end of course than 

at mid year. 

i oi this analysis S repro^rnts most i ogular viewing, and a negative 
change retlects a decreas<' in viewing regularity. 

Change from mid-year to final is statistically significant beyond .05 
level. 
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<U»crease in the regularity of .viewin-: . but this is probably explained 
oy a regression to the mean phenomenon. That is, this sample was originally 
obtained from those who were highly regular viewers. Some decrease in 
viewing on the part of this extreme group would be expected. As indicated 
previous 1/, the nonstudents viewing habits were quite regular throughout 
the series. 

Hxainination 

Results of the examination for students and for three com- 
paiison groups are given in Table 14. The examination, consisting of 
three open-ended questions, was not a part of the course; it was developed 
specifically and used only for the purposes of the evaluation project. The 
examination and the scoring key are in Appendix F. Scoring of the exam 
was done "blind" (that is, without knowledge of whose exam was being scored) 
and was highly reliable. It should be noted that absolute scores on the 
cxaii] have no meaning since its difficulty level is unknown; only relative 
scores can be interpreted. A comparison of full-time and part-time students 
indicated no difference in performance on the examination, so only the dis- 
tribution tor all students is given. The Introductory Psychology and ex- 
tension course comparison groups had been selected because they were some- 
what comparable to the full-time and part-time students, respectively. 
\h(sv two comparison grotps did not differ from each other, but both were 
significantly below the students in examination performance. Further, 42% 
of Arts 100 students scored above 12 whils only 5% of the two comparison 
groups did. And, only 10% of the Arts students scored below 7 as compared 
to 44% of the two comparison groups. These results indicate that at the end 
01 the year Arts 100 students were ahle to deal with material that other 
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university students could not handle. 

Our third compaiison groijp was actually not included in the 
original project design, but was, in fact, simply available and was in- 

Nil \ larily foi ex^ Ic/utory pu. - se.^. The grade 13 history students 
were described by their teacher as a highly motivated, quite bright 
group (a ni^inber of whom were the sons and daughters of University profes- 
sors) and should not be viewed ns a * presentative sample of grade 13 
Muivnts However, it i? - tercsti that this group was not signifi- 
cantly !)vl«*w the Arts 100 r.udents • the examination. The examination 
U \ not .attempt to measure nighly s cific course material, but was con- 
i.iod adequacy of i;r:)ach tc lae problems in communications and 

mass media and, in these areas at Ic.sl, it appears that a bright, well- 
read group of grade 13 students per >}med as well as students who had 
v'on»j*lefeV; Mie course. 

For the Arts 100 student^ correlations were computed between 
the examination and items on the fin;il evaluation questionnaire (see 
Appendix C). The examination scores ^^ere not significantly correlated 
with any of the evaluative items or with the average time spent on the 
^oijir^e. There was a smal. ;>osit ivc rreiation (r=.29, N=80, p<.05) 
» »«..r*eM ' xaininata^i r cou» ic<i , wltich were based on the seven 

lOvirsc afMgaments. There is, then, ome evidence of exam validity. 

The course grades did coD'^late significantly (p<.u5) with 
most of the general evalua'ion 5 tern correlations ranging from .26 to 

1H) and with average tLme per weeV ^pent on the course (r«.33). The 
cfverage tii;5C per week speiit on the : hwsc also had similar correlations 
.'th thv f.nal evalua^i.'h • *ms general relationship among course 

giadcb, av;»rage time spent on the course and the evaluative items was 
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probably a function of a variable not dir^^ctly measured.-motivation or 
involvement in the course. This interpretation is supported by the fact 
that the part-time students who spent more time on the course and gave 

' hiRher evaluatioi) . Is .•»bt£. in^^ g!i grades (average slightly 
hotter than B+) than did the full-tim.^ students (average B) . 

In summary, the exam results s'lowed that students in Arts 
100 were better able to make use of courso concepts than were two 
appropriate comparison groups. A third comparison group, apparently 
bright and well-read, did as well as \q Arts 100 students. To help 
clarify these results, i woMld navo » -on interesting to have given 
tne exam to a sample of /j ewers. Of *' >st importance perhaps was the 
confirmation that the pa:*t-time studo jts /ho can be assumed to have 
l-een more motivated and iinvolved in t^.- c mrse (and who spent more 
time at it) received bett:er grades and al .o rated the course more highly. 

Mass Media Survey 

Results of the Mass Media Survey are given in Appendix K 
fthe questionnaire is found in Appendix D). The survey dealt with any 
t ffocts that Arts 100 ha^ on use of tind ar.titudes toward the mass media. 
As has been indicated, the survey wa<= administered to the students, the 
viewers, and four compariso)i groups. Some of the comments indicate that 
this que<;r ionnaire was less clear and ^bre difficult to respond to than 
the other project material*^. 

The pattern results of the Mass Media Survey is not very 
clear and there is a good deal of variability in the data. However, 
c-^rt.iin trends do emerge: In terms 't" time spent on each of the media 
as sources of information, students rit.ed radio, books, TV, newspaper, 
magazines and movies in that order. The order is essentially the same 
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for the viewers and comparison groups, with just one reversal in each 
case. All groups expressed more doubt regarding the accuracy of the 
media in general than about those parts of each they selected. That 
"wha. I watch'' wa.^ it.«i as moi - ate and objective than "TV 

in general" and the same was true fof the other media. The full- and 
part-time students and the nonstudent viewers of Arts 100 had similar 
views regarding the accuracy of the in^dia and these tended to be more 
sceptical than those of the comparison groups. So, those involved in 
Ai*ts 100 believed the me»lia to be h ^ objective than those not involved. 

Respondents u-.r#> ,ask(d v her there had been any change in 
* o aiu iiudes in rec ^ i lonths. 11 ^:roups reported a good deal 
of change in use (as many as 60% in ^ome groups), but the amount of 
reported change was abou . the same for all groups. However, the Arts 
100 students and viewers reported much more change in a ttitudes than 
did the comparison group For exan^oie, '>4% of the Arts 100 students 
and 58% of the viewers r»^ported a ch '-ge ..n their attitudes toward 
television. Among the -..unparison groups only 27% reported such a 
change. A similar patteinn holds for each of the media surveyed. If 
fhi*5e reported changes can be accepted as reasonably accurate, it appears 
xUdt Arr^ did affect M'ldents* ar* ! viewers' attitudes and that, in 
general, chey became more wiitical ot the media. At the end of the year 
the medi « v ere seen as somewhat bia'^'^d'' by the students and viewers of 
Arts 100 

Conclusions and Implications 
Before suramari ' i ard di ussing the findings of this study 
we must note its methodological lirouations. These have been mentioned 
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earlier in this report, hut they are important and bear underscoring. 
First, while our sample ^€ Arts 100 students was large and quite 
adequate, the nonstudent viewers were a special group of volunteers (an 
educated, motivated and very interestt>d gf^oup), probably not typical of 
the viewers of the broadcasts. Generaliz itions from this group to all 
viewers are highly tentative. Second, thwe were no pre-course measures 
on any of the variables. While appropriate comparison groups were used 
i'\ sever.»: oases, they do not qu^te < -mpensate for the absence of pretests 
(which .ouid not cair^ oui be^aus ^ of ^ho timing of this project) and 
we must be cautious in attributing course **effects." Finally we would 
remind readers of someth'.ng which is, per taps, quite obvious, but is 
extremely important. Our findings re fer ml y to Arts 100; they do n^t 
pertain to other courses offered via t elevision, other ''multimedia' courses , 
or, indeed, any other co>irses . It would )e extremely hazardous to genera- 
lize from the positive findings concernin;] Arts 100 to, say, other educational 
television courses. Witn these limitations in mind, let us turn to the 
major findings and their implications 

Specific Components of Ar ts 100 

Most of the components of ihe course text, lecture notes, 
JV presentations, OECA workshop, etc.» were quite well received by all 
students. The OECA workshop was extremely well received* More such 
experiences would be well worthwhile- 

fhe weakest asp'^ct was the -eminars. An attempt to better 
train seminar leaders and to give moio direction to the seminars seems 
warranted. In addition, reducing the administrative problems mentioned 
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larlier (p. 38) would no dc jl>t help o ood deal to courterbalance the 
feeling of isolation generated by a 1*V course; the seminars could provide 
such contact. Further, some students rated the seminars very highly. 
Presumably they were useful to some s .dents and could be made useful 
to more of t^im. 

Another weak component wn^^ rhc phone-in system for feedback. 
h.)vvvcr, f'or those who u>eJ it, \t v^> c:eacrally viewed as successful, 
iiu majority who did not make use ot .t did not express any need to. 
Perhaps providing a number to call (at any time) for the few students 
wanting this kind of feedback would bt- sufficient. 

Some negative reactions we« expressed about the first five 
audiO'tapes, The last s sven tapes, t!< )se dealing with assignments, 
were seen as quite helpf il. This point would be worth following up in 
subsequent offerings of Arts 100. 

For some of tie part-time students accessibility of reading 
materials posed a proble^^ That could -sllv be solved by better arrange- 
ments with local public libraries. 

The use of "academic", technical language was a complaint of 
almost half of the full-time students, but relatively few of the part-time 
1. Indents anJ viewers. When videotapes are re-done this point should be 
borne in mind. 

1 c neral Lvaluation of Ar cs i /£ 

Arts 100 was very well received by the part-time students and 
nonstudent viewers, who were quite enthusiastic about the course. The 
full-time students ratings were modeiately positive* but somewhat below 
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the average rating of a comparison group of Psychology courses. For 
full-time students Arts 100 was just another course. The improved 
evaluation by the students from mid-year to the end of the course 
probably reflects greater interest ii) the material on the mass media 
in comparison with the material on the brain and the senses. The 
material on the physiology of the brain and the senses was not well 
received and could probably be shortened and made more interesting. 
Conceivably, it could come later in the course when students' interest 
might be higher and the relevance of the material more obvious. 

The regularity of viewing by the nonstudent viewers suggests 
that Arts 100 is capable of attracting and maintaining an audience of 
this sort. 

Many students watched the lectures more thaii once and found 
it useful to be able to do. Broadcasting then several times a week 
should be continued. A few students and viewers complained that the 
broadcast times were Inconvenient. 

Results of tie examination inoicate that Arts 100 students 
were more able to deal with material involving communications than 
Were University student*, in other courses* 

From responses to a question concerning effects, comments on 
the most valuable aspects, and the mass media survey, it seems clear 
that Artf^ 100 had attitudjr>al effects on students as well as nonstudents. 
Both groups reported more critical views of the media and increased 
insight into the limitations of the media in attempting to present 
reality* 
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In suflunary, then, the first offering of Arts 100 in this 
way must be viewed as sui:cessful. While u couple of aspects require 
improvement, the overall evaluation of thi^ course was quite positive. 
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APPENDIX A 



ARTS 100 EVALUATION PROJECT 
General Information Sheet 

UMiE: STUDENT NUMBER: 



LOCAL ADDRESS' 



HHONE NUMBER: BEST TIME TO REACH YOU:^ 

AGE: SEX: NATIVE LANGUAGE: 



(X:CUPATI0N: 



Highest level of formal education successfully completed (check one): 

grade 8 or less Note: If not educated in Ontario, reply 

grades 9-11 in terns of Ontario equivalent. 

grade 12 

grade 13 

community college or equivalent (teachers' college, nursing school, etc.) 

some university 

other (specify) 



r<tudent status: 



full-time student 
pait-time degree scudent 
non-degree part-tine student 



ilow many previous university courses have you completed? 

full-year (twD semester) courses or equivalent 

Did you apply to the University primarily to take Arts 100? Yes; No 

hid you enter the University as an "adult** student (a person of mature age who has 
been away from formal education for at least ti^o years and who does not meet the 
legular admisr.lon requirements) ? Yes; No 

FACULTY OR PROGRAMME ENROLLED IN (e.g.. Engineering, Arts): 

YEAR: 



Where (city) do you meet for your monthly seminars? 

Vtiat were your original reasons for taking Arts 100? 
What do you hope to get out of the course? 



Do you watch the lectures on: black and white TV, or colour TV 
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:»ROJECT CODE NUMBER: 



WEEK STARnNG; Monday 



ARTS 100 I'VALUATIGN PROJECT 
Weekly Activity Sheet 

I lease indicate your activities related to Arts 100 and how much time you spent 
on each during the week Indicated above. Below are listed varlous~course- related 
.ctlvltles. Indicate which you did and when you did them by putting the times in 
the appropriate boxes. For example, if you watched a TV lecture from 7:00 to 7:30 
•■•uesday evening and read The New Literacy from 10:00 to 11:30 Saturday morning, 
.'ou would put "7-7:30 PM" in the first box of the Tuesday column and "10-11:30 AM" 
vn the sixth box of the Saturday column. Similarly, for the other things you did. 
Aote that there are also spaceit to indicate other course-related activities not 
listed below (e.g., other reading, discussion, etc.). 



MONDAY 



TUESDAY WEDNESDAY THURSDAY 



s 

J 

n 

% 

sr 



o. 



Watched TV lecture 



Phoned In ^fter TV lecture 



Read notes from lecture 



Listened to audio tapes 



Read notes from audio tapes 



Read The New Literacy 



Read other material 
related to course 



Attended monthly seninar 



Prepared assignment 



Other (specify) 





FRIDAY SATURDAY SUNDAY 

\ \ 



I 



- 09 - 



60 



ERIC 



I'ROJECT CODE NUMBER: WEEK STARTING: Monday 



ARTS 100 EVALUATION PROJECT , 
Activity Evaluation Sheet 

We would like to get your evaluation of the worth of the various activities relate 
to Arts 100 that you engaged In during the week Indicated above . The course-relate 
activities you might have done are listed blT^. Please Indixlfte how valuable you 
found each one by circling the appropriate number on the rating scale beside that 
activity. The more valuable you thought the activity, the higher the number you 
would circle. Try to make your ratings accurately reflect your evaluation of each 
"Pf'^^^^'^ activity. Indicate the activities you didn't do last week by checklnilEhe 
column at the extreme right. 

Little or Extremely Didn't Do 

No Value Worthwhile Last Week 



Saw TV lecture 12 3 4 5 6 



Read The New Llterac 



1 



chapter 1.2 3 4 5 6 

chapter 1 2 3 4 5 6 

chapter 1 2 3 4 5 6 

Read other material related to 

course (specify) : 1 2 3 4 5 6 



Other relevant activities 
(specify) : 
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I honed in after lecture 1 2 3 4 5 6 7 

lead notes from video tapes 

topics 1 2 3 4 5 7 



Listened to audio tapes 

topic 1 2 3 4 5 6 7 

topic 1 2 3 4 5 6 7 

topic 1 2 3 4 5 6 7 

topic ^ 1 2 3 4 5 6 7 

Read notes from audio tapes 12 3 4 5 6 7 



Partja. Below, please indicate whether the TV reception was "normal" or whether 
there was something wrong with the: 



Picture: 
Sound: 



Par^^. Now, would you also please evaluate the following aspects of the course 
(these need not have been done during the past week) : 

Last completed assignment 

^^^^^r 1 2 3 4 5 6 7 

Seminar most recently attended 

tnonth 1 2 3 4 5 6 7 



Do you think your ratings acmrately reflect your cvHluaLLuu o£ the various course 
activities? ^ Yes; No 

If not, please elaborate. 



Other comments? 



71 



- 61 - 
APPENDIX C 
Student Evaluation Questionnaire 



Student status: full-time 

part-time degree 

non-degree part-time 

Did you apply to the University prim ^rilv to take Arts 100? yes 

no 

Were you admitted as a "mature*' stuc^M\t \did not meet the University's 
reqular grade 13 admission requirement s) '' yes; no 

Ploase answer questions 1-22 by circling the letter of the alternative 
thrit best answers each question. Place any comments about your answers 
in the spaces to the right of the alternatives. If an item asks you to 
evaluate part of the course which you haven't done (e.g., the OECA 
workshop) or materials you haven't used (e.g., the audio tapes), ignore 
th«it item. 

!• To what extent has Arts iOO met year personal expectations? 



Comments 



(a) almost completely 

(b) to a considerable extent 

(c) somewhat 

(d) a little 

(e) not at all 

2, To what extent has Arts 100 met the objectives stated in its brochure? 

(a) almost completely 1 Comments 

(b) ta a considerable extent 

(c) somewhat 

(d) a little 

(e) not at all 

3, How would you rate Arts lOO overall? 

it) excellent ; CcMnments ... 

(!•) very good 

fc) go(;tl 1 

(e) poor 

4, Would you recommend to a friend that he or she take Arts 100? 

(a) yes, recommend it highly ; Comments ... 

(b) yes } 

(c) don ' t know i 

(d) no I 

(e) definitely not i 
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5. How inteiresting did you find the course? 

. \) extremely interr- ■ t-mg ;oinmonts 

(b) quite interrstitv, 

(c) interesting 

(d) not very interesting } 

(e) boring ' ^ 

f>, would yiu rate Arts 100 in comparison with other university courses? 

(a) one of the best i Comments ••• 

(b) better than most 

(c) about average 

(d) not as good a^ most 

(c) one of the poor' 

7. n,, , that the \ \ '.evotOv' > / ts 100 was well spent? 

{h) always I'^omnents ... 

(h) usually i 
(<:) sometimes } 

(d) seldom ; 

(e) nev»'r 

8. How intellectually stimulating di t you find the course? 

(a) highly 1 Comments ... 

(b) quite 

(c) som^^what 

(d) slightly 

(e) not at all 

9. How understandable did you find t5f^ TJ lectures? 

(a) ext^^mcly underst n.lable omrn«^,nts ... 
.b» rjuiv- Mnder^vtant] 'I i 

vc) understandable . 
id) not very understar.dable \ 
(tj) not at all undcrs :andable 1 

10. Hew do you feel about t^e amount of material covered in the lectures? 

la) too much » Ooroments ... 

(b) ju^:t about right i 

(c) too little 1 

11. Ii\>^ worthwhile did ^^ov : . nd the . >ok "The New Literacy"? 

(a) ex^ r^-^m^j ly wortr>wh » lo :om.aents . . . 

(b) quite worthwhile 
[r) worthwhile 

(d) of little worth 

(c) a waste of time 
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12. How worthwhile did you find the monthly seminars? 

(a) extremely worthwhile | Comments ... 

(b) quite worthwhile | 

(c) worthwhile i 

(d) of little worth i 

(e) a waste of time • 

13. How worthwhile did you find the d^signments? 

(a) extremely worthwhile i Comn»ents ... 

(b) quite worthwhile i 
Ic) worthwhile | 
(d) of little worth i 

(o) a waste of time i ^ 

14. HOW worthwhile did you find the T.V. lectures? 
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(•omments 



(a) extremely worthwhile 

(b) quite worthwhile 

(c) wort,hwhile 

(d) of • ittle worth 

(e) a waste of time 

15. HOW worthwhile did you find the notes on the lectures? 

(a) extremely worthwhile 1 Comments 

(b) quite worthwhile 

(c) worthwhile 

(d) of little worth 

(e) a waste of time 

16. How worthwhile did you find the iidio tapes? 

(a) extremely worthwhile i Comments .. 

(b) quite worthwhile 

(c) worthwhile 

(d) of little worth 

(e) a waste of time 

17. HOW worthwhile did you find the ^>ECA TV workshop? 

(a) ex^romoly worths h J OomjT\ents ... 

(L^) qu ' " .-'orthwhi i ^ 
(c) wox cfiwliile I 



(d) of little worth 



(e) a waste of time i 
What effect do you think the use of the puppet had on the TV lectures? 

(a) considerably aided ! Comments ... 

(b) somewhat aided ! 

(c) neither aided nor ietractc 1 

(d) somewhat detractevi , 
(o) co-*3iderably detr-^^ ted 
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19. How do you feel about Professor Gordon's use of "academic" or 
technical language? 



21 



(a) too much of it 

(b) just about right 

(c) too little of it 



Comments 



20. now do you feel about tho amount £ < ime Prof. Gordon was on camera? 

(a) too much ! 'omments 

(b) just about right 

(c) too little 



How effective did you find the illustrative materials used in 
the TV lectures? 



(a) considerably aided 

(b) somowhat aided 

\c) neither aided nor detractc 

(d) somewhat detracted 

(e) considerably detracted 



'omments 



22 How do you feel the fonnat of hi' , 100 compares with "standard" 

Comments • • • 



university course form.its? 



(a) much better 

(b) better 

(c) about as good 

(d) not as good 

(e) much worse 



2J»a). Did the "hot line" satisfactOi ily meet your needs? 



yes 
no 

didn't US3 



If you checked "no" "didn't use", please indicate why. 



ib) . What otiier arrangemei ts would you like to see for receiving your 
comments, providing i^u with holp or feedback, etc.? 



24. Di 1 you fii.d that secondary reading materials were accessible enough 
fox" your needs? yes; no 



Please elaborate. 
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25, Beyond providing course content, has Arts 100 had any effect on what 
you do, think, believe, etc.? yes; no 



Pic^ase elaborate, 



26 Rou^jhly how much time :Der week did you spend on Arts 100 (including 
TV viewing, reading, preparing assignments, etc,)? 

Average time spent per week - hours. 

In •(^mpaii^<)n with oth * rourser- \ :00 took: 

more time 

about the sam^ amount ' time 
' less time 



27 The most valuable aspei:ts of the -^ourse were ... 



28 The least val»^^ble asp«3cts of tho .:ourSe were ... 



20 n »A would y Ai like to se^ the course changed? 
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APPENDIX D 

Mass Media Survey 

!• On (hti average how many hours a wr-. do you spend on each of the 
roJ lowing media as a so^xrco of inf unation? 



(a) TV 

C » Radio 

(w*) Newspapers 

(d) Magazines 

(e) Books 

( * Mo^ » (not on T 

Ofhor: 



Please elaborate 



Below please indicate your opinion* regarding* how accurate as sources 
of information the various media a^e. Do this separately fox: (1) the 
media in general, and {I) your choice from each of thera. 



TV: 

R<^d j o: 
NQwspdpera : 
Haqa/, ines : 
Books : 

Mo;7M*.> (n..t )n TV) 



In g.aneral 
What I watch 

In g*m^ ral 
What I listen t 

In gen^'tal 
What I read 

In gonoral 
What 1 read 

In general 
What I read 



: In j» 
What 



i ral 
watc^ 



.ice Reasonably Somewhat Quite 
ante Accurate Biased Biased 



Conmeni'- . 
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3, Has there been any change in your use of these media in recent months? 

Yes No Please elaborate: 

(a) TV 

(b) Radio 

' Newspapers 

(d) Magazines 

(e) Books 

(f) Movies (not on Tf) , 

Other: _ ^ 



4. Has there been any chan*je in your opinions of or attitudes toward 
these media in recent months? 

Yes No Pxease elaborate: 

(a) TV 

(b) Radio 

(c) Newspapers 

(d) Magazines ^ 

(e) Books : 

(f) Movies (not on TV) 

Other: 



Please write any comments about this questionnaire below. Additional 
comments about the questionnaire or Arts 100 can be written on the back 
of this page. 
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APPENDIX E 

Nonstudent Evaluation «^estionnaire 



PU'ase answer questions 1-14 by circling the letter of the alternative 
that best answers each question. Place any comments about your answers 
in the spaces to the right of the alternatives. 



I. Hc,*v t <julai ly did you watch the bi adrasts? 



(<4) evL^ y week 

(b) missed occasional one 

(c) about 3 weeks out of 4 

(d) roughly half of them 

(e) les*? than half of them 



omiaents 



1. How would /ou rate Arts 1)0 overa •? 

(a) exc nient ! Comments ... 

(b) very good i 

(c) good ! 

(d) fair ; 

(o) poo • 

3. In comparison with all other proyr xmmes you watch on TV, how 
would you rate Arts 100? 

(a) one cf the best \ '^^omments ... 

(b) bethrr than most ^ 
(<z) about average j 

(d) not as good as most j 

(e) one of the poorest \ 

4. tri comparison with other prograumnps you watch on "educational" TV, 
how would you rate Arts 100? 



(d) one of the best : Comments 

(t) better than most. 

(c) about average 

(d) not" ds good as mo t 
« ont f the poort^s* 

Would you recommend to a friend that he or she watch Arts 100? 

(5> ye^ , recommend it highly 1 Comments 

(b) yer, 

(c) don't know 

(d) no 

(e) def ini tely not 



6. How interesting did you find the 

extCMueLy interoL^r^ng 
1*^.' quit'^ interesting 

interesting 

no^ very interesting 
(e) boring 



rocirammes? 
:onunents . . 
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7. How informative did you find the programmes? 

(a) extremely j Comments ... 

(b) quite | . . 

(c) somewhat i 

(d) slightly | 
( nof at all 

8. How mteliocLually stimuiuting dl .^/oi. find them^ 

(a) highly i Comments ... 

(b) quite | 

(c) somewhat ' 

(d) slightly • 

(e) not at all | 

9. How would you rate the clarity of » he presentations? 

(a) extremely clear ! •'omments 

(b) quite clear 

(c) clear 

(d) not very clear 

(e) not at all clear 

10. How do you feel about the amount of material covered? 



(a) too much 

(b) just about right 

(c) too little 



comments . . . 



11 what effect do you thin> the use 'f tihe puppet had on the programmes 

(a) considerably aid^d j Comments ... 

(b) somewhat aided j 

(c) neither aided nor detracted 

(d) somewhat detracted I 

(e) considerably detracted ' 

1^ Hov/ do you eeel about Professor -rrdon's use of "academic" or 
technical linguage? 



(a) too much 

(b) just about right 

(c) too little 



^ omm^nts 



13, How do you feel about the amount of time Prof. Gordon was on camera? 



(a) too much [Comments ... 

(b) just about right } 

(c) too little f 

14, How effectivo did you ^ * ^ the i. astrative materials used? 

(a) con.siderably aided j ;omments ... 

(b) somc^what aided ; 

(c) neither aided nor detracteci 

(d) somewhat detracted 



izrnn <g) considerably detracted J 
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15. Beyond providing information^ has Arts 100 had any effect on what 
you do, think, believe, etc.? Yes; No 



Please elaborate. 



16. The most valuable aspects of the broadcasts were ... 



17. The least valuable aspects of the broadcasts were 



18. Did you find the broadcast times convenient? Yes; No 

Please elaborate. , 



19, How would you like to see the Arts 100 series changed? 
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APPKNDIX F 

V 

Lxamination 

Project Code Number: 



llu <|Uf.t 101.^ i>'»low deal wjt^\ the suhjett jf c.Mnmunications, While very long 
anbutr.^ ooulJ be written to the questions you are asked to answer them briefly 
In one page or less. This means that you won't be able to elaborate much upon 
your iileas. You should spen'i no more thnn 15 minutes on each question, 

1. \(iu are interested in knowing what happening in the world. You get your 
information by watching the evening ^ ws on TV. What sorts of things would 
V consist r in deciding h^w accurat 'his information is? 

2. are micrested in kno.^ how reli.ible your sense of taste is. How 
would you go about compariiig it with ^shat is "average*'? 

Wliai wouM \'o*i keep in nww^ in tryin. o explain things (like snow) to 
people who are unfamiliar vith them iiike Arabs)? 



Note: l.ach question appeared on the top of a different page, with the rest of 
the page (and the back if necessary) available for the answer. 
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Scoring Manua l 

The rollowing arc actual sample answers chosen from the evaluation 
examinations which are to be used simply to provide an idea of the scope and 
quaJity of answer required for each score. TIxe answers are not necessarily of 
great depth or clarity, in the case of questions for which more than one 
po!-t ,-..»ld he awarded, the ir^ermin ^tion oF 'b- actual score was made on the 



1 po.tt - a mention of the conci^r without elaboration 

points - inclusion of one aspect or factor with elaboration or 
of two aspects without elaboration 

5 points - inclusion of two aspec^ w.rh elaboration or three aspects 
without elaboration. 

\ points - inclusion of three asp ts with elaboration or of f^ur or 
more aspe:t»' without . ' horation. 

in every category fov wnich more uan one point was awarded several 
asptM-i^ or factors could be included in the answer. 



Ques tion HI 

l911^, .^H \ 'filil e nsorship (4 po nt . max ? mum) 

1 pojpt^ " Does the station which »s showing it or the source from 
where it was received have censor .ship? 

2 points > The first thing which • ist be considered is whether or not 
the station, program, announcer or sponsor would have any reason for 
presenting a biased approach to the subject. 

ll^^'^^^t^ What type of slant doos that station take? How is the station 
owned, i.e., public, government subsidized or private - Have social slants 
been s^v/n previously in their br'-.ndcasting (e.g., no negroes in the com- 

inercial^ or intcrvie-.^ . 

l^oi Ai not <iward< J A f(>ur i )int answer could include the control 
^iiid ceiVHor'ship of statuui owners, iicencers, advertisers and government, 
*>ith elaboration. 

^?J^^l I'^'Ul^J \ poi nts maximum ^^ 

^ poin t - 'ITie medium of television has technical limitations which make 
selection material necessary. 

2 points - For instance, if i am <ihown a scene of a riot and police are 
presented clubbing thr< demonst> • ors, I won't accept this as an example 
of th»- vJubbing of h mi; -ds of ers My understanding of camera angles, 
lense- . framing etc, a. ) forces » • to qualify the material presented for 
my at -etit ion. 
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3 points - Time limitations resulting in condensation cause selection 
of certain material. Some stories are scrapped because they cannot be 
visualized. Stories are passed over or just mentioned because they 
lack the excitement that jmost editor's demand of material. Some areas 
are inaccessible to cameras. Thrr^* 15 selectivity in film shots. 

< ^J^y^ l* ' t2 points ma < '\ \ \m) 

^ point - I would tu:m to other newscasts, the newspaper and radio. 

2 points - Compare different networks news and the news of other media 
and relate the report to our own first-hand knowledge of the situation. 

lauthon ty) (2 points t^.o imum) 

Lji^iill ^ ^^^^ ider wh " ihe; say they are using as a source 

for their information 

2 points - Never awarded. This would include an elaboration of the 
above answer. 

Scorable Answers (1 point each) 

Sourc e type : I would have to taS^e in :o consideration that while seeing 
an even on televisio i which take sji Siberia, the Siberian problem may 
not really be intell gibie 10 us. 

Person nel bias : I would like to miow whether the broadcasters are biased 
heavily or not. The biases that :hey have may be projected into the in- 
formation they give to the public, eVi?n though they may be unaware of it 
and this could radically alter the wa' the public looks at the situation. 

Consideration of audience to which tho news is directed ; Whether the 
station is just trying to present whac the public wants to hear. 

Time} i ness : How curroit is the ri*porcing of a news item. 

intc» ^3 fiom • '\ ^ d#*s of the story given? 

Intt ii> vetation accorctiug to cul t ;/al i r^nd : To what extent are facts 
interpreted in the light of the cultural beliefs of the people reporting 
to and controlling the media or in the light of the cultural beliefs of 
the society for whom the news is written. 

Commentator and/or reporter image : Thft announcer's projected image -- 
does he seem to be factual or does he seem to embellish certain news 
items? 

Gove rns eat pol icy : Whit is the ..overnment policy toward the country 
di5Cf: s Is it r» f * ♦.ed in in orpretation of the news item. 
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Consideration of bas ic a ssumptio ns: What basic assumptions is the station 
making about a story or about its viewing public. 

Presentation : Format oif the report (audio-visual etc.) 

Statio n Reputation : History of t rodibility of the station, i.e., past 
tiort'crfiiance. 

Medium : fhe medium of television is limited as to what it can communicate 
and the impact it will have. 



Concept of Standardized Measurement (4 points maximum) 



1 point - I would first have to find an objective test with which to measure. 

2 points - I should select a certain number of foods and give each of them 
to a group of people who would tell me how they tasted. 

3 points - Choose substances tha- arc known to be rweet, salty, sour and 
bitt r" and have a group of peopl^ test them and teJl me how they taste. 
Now • how do they taste to me? 

4 point s - Basic tastes sweet, sour, bitter, salty. With a large number 
of persons have them categori?.^ various foods on a scale as to: 

a. very sweet 

b. sweet 

c. slightly sweet 
a. very sour 

i>. sour 

slightly ijour 
i. very bitter 
. bitter 

slightlv i \ ' r 
a. very salt> 
l>. salty 

c. slightly salty 

Now, 1, not knowing how the othci s categorized these foods, would categorize 
them and compare my results against those of the group of people. Note: 
This shows how I label foods i^ot really how they taste to me. 

Comparison with select reference group j « points maximum) 

1 poin t - 1 should have to gathe a group of people whom I consider average. 

2jjoini^ - The people i am corny* ng my taste to — have they been brought 
up i" the same type or culture e» . that I have did they eat 'Tried 
potatoes and apple pie** or were they raised on caviar ? Have they been 
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raised with restrictvons similar to mine? Have the/ been in an 
anti-alcoholic family? 

3 points - First, I would have to decide approximately what I could 
consider Average', t would tend d-'sregard groups such as 'smokers*, 
rhe/ are obviously tot average tl»» ir tastes are impaired. Then, 

1 wi>(Jtl have to . \* j^eoi le ' Ser cultures who have developed 

diilerent taste paticii . I wou a pu. Ably select as average a group 
of people who are culturally com^^arable to me and who do not smoke 
or use a lot more or less chemicals than I do. Therefore, I would 
ask questions of and observe people wtio are living in the same culture 
and environment as I am. 

4 points - The first question is "what is average?". To obtain an 
average group, I must "delect from among people who are from my cul- 
ture, my socio-economiv group, n- be from my age group, and who do not 
have diseases or hab'.ts that affect the taste. I would also obtain 

at least one hundred foods and liquid;. Then, with myself in ons 
room and these people in another, we would proceed to taste at pre- 
determined intervals the entire srock and label according to pre - 
specified labels how we thought each particular item tasted* Then, 
if I agreed with the labelling of this group of people, I would con- 
sider myself 'average'. 

Othe£ Sc orabl e Answers (1 po Lnt each ) 

Defin i tion of Average : What is era^e? That is the first stuinbling 
blocVT 

Cross R eference : I would remember ta;te of something familiar in a 
certain way, therefore the memory of it would make it taste as I 
remember it tasted. 

Consistency of Taste : Taste seenin to be subjective and not always the 
same for the same foods. 

AfffeL ti ng Factors : Smoking, dis use, age these have an effect on 

tast< 

Cros'>- se nsory Stimu lation: (n r ting the reliability of taste, I 
musT remember that n.osf of our ta<^te sensations are coupled with our 
sensi of smell and sij,*:. 

i.unc '[H o f the Diffe rcti ce Bctwe v- the Perception of Taste and the 
Sensation of it : The way one understands a taste may be different 
from the taste on the tongue. 



(jtios^t ion ^5 

Analjgv (4 poiuls maximum) 

1 p^'Jl^ ■ •^^l*^^ snow 10 sometl' they are familiar with. 
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2 points - Base your explanation on something in their own experience 
(like sand). 

3 points - Use of comparisons and analogies. Snow, for instance » can 

be rr^Uted to wat-^r :^ sul sts" ' v n to everybody and to sand, 
something known to xYt Arabs. 

4 p oints - Empiricism, analogy ai»<J refulatiOn all would then come: into 
play. I would compaie snow or anythirg else to something that they 
are familiar with. For instance, rain. "Snow is like rain, only the 
drops are frozen into white patters which do not always melt into the 
grounds but stay piled up on top of it." 

Jjnpj rij. i sm (5 points maximum^ ^ 

1 poin t - They must touch snow. I would take snow to them. 

2 po ints - Pictures. or films of snow riight help also an explanation 
that it was cold. ^ 

3 poiats • If possib>e, I would show the ice which forms in a freezer and 
indicate that snow ir close in appearance to this. I could gather pictures 
of snow from magazines, photos, etc., and augment m/ explanation with 
these. 

^cora bi 2 A nswers (1 po .rr each) 

Gestural Implications or Body La i. ^uago : By moving ray face or body a 
certain way, I might inadvertently co'.our my description or their 
understanding of it. 

Common Experience : l;ven explanations are difficult because there is 
little common experii'^nce on which to '}ase an explanation. 

Cont ext: I should bj aware that in their living context, snow is 
incomprehensible. 

tveg li j< 1 n (i)' a (or'^ ^ lan^uag- W r could look up the word snow in 
a di< t onary . 

Lang 'ia ^^c Barrier : I must choose my words so that they imply to the Arabs 
what I mean them to imply. 

Clarity of Explanation : Keep the explanation as simple and as concise 
and t:lear as possible. 

Concept that Basic Assumptions c?!nnot be made : One should keep in mind 
that their frame of reference would be different from ours, that in 
describing something ¥^ must not let our particular prejudices about 
snow show. 
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Empathy : Be understanding and try to feel how they are reacting. 

Feedback : I would w.itch their faces and listen to their verbal 
reactions to determine if they were understanding me. 
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APPENDIX ^ 
Intercorrela tj ons 
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Table 15 
a 



Intercorrelation^ (Students N«145) 



Variable 



2. 
3. 
4. 
5. 
6. 
7. 
8. 
9. 
0. 
U. 
2. 
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18. 
9. 
20. 
1. 
12. 
23. 
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r«ble 15 - (Cont'd) 
Intercorrelations (Students N«145) 
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INTRODUCTION ^ . 

The course Communications lOOE, v(as offered at Erin- 
dale College of the University of Toronto during the 1971/72 
academic year* It is based on "Arts 100: Communications — 
A Course on the New Literacy**, a University of Waterloo, multi- 
media course offered at that University in co-operation with 
The "Ontario Educational Communications Authority (OECA) . The 
major component of Arts 100 is 30 weekly half-hour television 
^l>roadcasts, each of which consists of a lectui-e by Professor 
- — Donald Gordon "i llustr a t e d - with numerous- vari e d vis^iai — 
materials and supplemented by dialogue with a puppet. The 
other components of Arts 100 are 12 audio-tape cassettes, an 
assigned text: The New Li ter^cy by Professor Gordon, a 
reading list, printed notes on the audio and video materials, 
monthly tutorials held in various locations throughout the 
area, provision for comments and questions from students via 
the mail and telephone (the toll-free ••hot-line"), an OECA 
TV production workshop on problems related to production of 
media material, and seven research assignments to be completed 
by the students (and on the basis of which they were graded) . 
Arts 100 as taught at Waterloo during 1971/72 did not include 
regular class meetings at which all students assembled. Arts 
100 was designed to accommodate full-time students, part-time 
students, and non^students working on their own at home (ex- 
cept during the monthly small group tutorials and the single 
OECA workshop). 102 
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In principle, Communications lOOE was to be the 'same 
course' as hrts 100, but certain circumstances led to a 
number of differences between the two courses. One kind of 
difference concerned pr^)motion. The decision to offer the 
course at Erindale was not made until after the formal 
registration period was over at the College. Thus, students 
did not know that the course was a possible choice for them 
until it was about to begin, and by the time it was announced 
most students were 'settled' in their courses. Furthermore, 
at least some of the promotional material published to 
~ advelrtTseTTf ts^XCror was" rTot a vatXablj&~Tro^ inspection " tjy ^ ~^ 

prospective students at Eifindale. These facts may partially 
explain the small siase of the class and any initial miscon- 
ceptions the students had .about the nature of the course. 

A second kind of difference concerned the components 
of the courses. Arts 3.00 as taught 'by TV' has been 
described* Communications lOOE differed from it in one very 
basic way. It was assigned a scheduled meeting time, the 
first half-hour of which coincided with one of the time slots for 
the weekly TV programs. Mrs. Sandra Sachs, who had previously 
taught Arts 100 'live' before the TV lectures were available, 
was hired by Erindale to meet the class each week at the scheduled 
time. Thus, Communications lOOfe met regularly, whereas all 
the students of Arts IQO never met together. Related to this 
very basis difference are a number of other differences re- 
garding components; (a) for the first half year the Erindale 
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Students watched the TV programs together in class; (b) Mrs. 
Sachs provided the students with an extensive reading list 
which was not the same as the Arts 100 reading list; (c) 
monthly tutorials^ were not necessary for the Erindale stu- 
dents since these students met weekly; (d) provision for 
comments and questions via mail and telephone was likewise 
unnecessary; (e) Mrs. Sachs chose to evaluate the students on 
the basis of a major project and an exam, not on the basis of 
the seven assignments; and (f) the class engaged in various 
activities which were not equivalent to any of Arts 100 's 
components, including listening to guest speakers, attending 
a play I visiting a xadio studio, and attending a movie. Thus, 
Communications lOOE, although based on Arts 100, was very 
different from Arts 100. 

The purpose of this evaluation is to summarize the 
opinions of the registered students about Communications lOOE. 
There are no pre*tests or control groups because the decision 
to undertake the evaluation was not made until after the 
course was over. Fortunately, an evaluation questior^aire had 
been filled out at the end of the course. Furthermore, no 
attempt is made to draw general conclusions. Not only is the 
num):^er of students small, but there is little justification 
for trying to say anything about any course except Communica-* 
tions lOOE as offered at Erindale during the 1971/72 academic 
year. Therefore, this evaluation had distinct limitations and 
should be viewed more as a retrospective case history rather 
than as either a thorough evaluation of a single course or a 
collection of data from which broad generalisations can be made. 
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•Most of the students in Communications lOOE expected a 
eoura^ on medl-anan* media techniques. 



-The course fulfilled the expectations of many of the students. 



•The 'overall rating of the course by the students was favour- 
able. 



-The best received components of the course were the OECA 
workshop » the class trips, the class discussions, the 
guest speakers, and the Tl lust rative materials use^ 
TV lecturW. Also, some of the specific topics, such as 
hypnotism and advertising were very well received. 



-The informality and flexibility with which the course was 
conducted was greatly appreciated by the students. 



-Some components and parts of components of the course were 
disliked or ignored, including some of the TV programs (those 
on the brain and senses) , some aspects of all the TV programs 
(the puppet and the technical language), the text, the notes, 
and the audiotapes. 



-The students claimed to have become more critical with respect 
to the media as sources of information during the period ot 
the course. 
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METHOD 

Twelve Erindale students were registered in the 
course. Eleven of these completed the Final Questionn- 
aire with attached Mass Media Survey at the end of the 
academic year. The Questionnaire and Survey were 
originally designed for students at the University of 
Waterloo. The Questionnaire consisted of 29 questions, 
mostly, but not exclusively, of the multiple-choice 
variety. It was chiefly concerned with opinions regarding 
the course and its specific components. Five of the 
.priginal questions were omitted by all students since they 
did not apply to the course as conducted at Erindale, but 
five supplemental questions that were pertinent replaced 
these. A cbpy of the Questionnaire including the supple- 
mental questions is in the Appendix. The Survey consisted 
of questions about the student's use of the media and about 
opinions regarding the media. A copy of the Survey is also 

in the Appendix. 

Seven of the students (all those who could be located 
at the time) were interviewed over the telephone by the 
author several weeks after the end of the course. The 
questions asked concerned how the students had heard about 
the course, their expectations and the benefits they 
received, the course components, and how the course should 
be changed. A list of the questions asked is found in the 
Appendix . 
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RESULTS AND DISCUSSION 

Fin^l Questionnaire . Table 1 presents the results 
obtained from the 'objective' items on the pinal Question- 
naire. In bases where the student expressed his opinion on 
a five point rating scale (items 1, 3-9, 11, 14-18, 21, 22), 
numerical scores «pere assigned to the lettered responses 
juch that the most positive response, a, was assigned a 
score of five, the second most positive response, b, was 
assigned a score of four, and so on, so that cesponse e was 
assigned a score of oiie. These evaXuation 8c<r^ ~ 
averaged for each relevant item apd the means, along with 
the number (N) of students responding to each item are 
indicated in the column "Results." The items themselves 
are paraphrased in the column "item." Thus, for example, 
the mean of 3.00 for item 9 indicates that, on the average, 
the students thought the TV lectures were understandable (see 
alternatives on sample Questionnaire in Appendix) . 

If we assume that a score of 3.00 (the mid-point of each 
of the scales) represents a neutral opinion, then the results 
obtained with the rating scales can be summarized in the 
following manner: -The students were generally positive 
(favourable) about the course as a whole, as indicated by 
the fact that the mean evaluation scores on all general 
items concerning the course (items 1, 3-8, 22) were 3.50 or 
greater. On the other hand, the students were negative about 
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TABLE 1 

Results obtained from 'objective' questions 
on the Final Questionnaire 



Item 



Results 



I. Has course met your personal 
expectations? 

3. How would you rate Arts 100 
overall? 

4. Would you recommend course 
tfs a friend? 



5. How interesting was the 
course? 

6. How would you rate Arts 100 
in comparison with other 
courses? 

7. Was time devoted well spent? 



8. 
9. 
11. 



Did it stimulate intellectual 
curiosity? 

How understandable were the 
lectures? 

Worth of textbook. 



14. Worth of TV lectures. 



15. Worth of lecture notes. 



16. Worth of audio t^es. 



17. Worti of OECA workshop. 



Mean 

N 

Mean 

N 

Mean 
N 

Mean 
N 

Mean 
N 



Mean 
N 

Mean 
N 

Mean 
N 

Mean 
N 

Mean 
N 

Mean 
N 

Mean 
N 

Mean 
N 



3.72 
11 

3.90 
11 

4.09 

II 

4.63 
11 

3.90 
11 



4.54 

11 

4.36 
11 

3.00 
11 

144 

9 

1.90 
11 

2.44 

9 

2.25 
4 

3.75 
4 
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TABLE 1 - Cont'd 



Item* 



Results 



18. 


Effects of puppet on TV 
lectures. 


Mean 
N 


V 

2.40 
10 




21. 


Effect of illustrative . 
materials. 


Mean 
N 


3.90 
10 




2.2 # 


How fomat compares with 
"standard". 


Mean 

N 


10 




10. 


Amount of material covered 
in lectures. 


Too much 

About irlnht 

Too little 


4 

2 


(36. 3t) 
(18.1%) 


19. 


Use of "academic" lanauaae. 


Too mil eh 

A \^\^ III A A 

About right 
Too little 


A 
H 

4 

0 


/CA Aft| 

\0\f . U V / 

(50.0%) 
(00.0%) 


20. 


Time prof, was oh camera. 


Too much 
About right 
Tbo little 


4 

6 
0 


(40.0%) 
(60.0%) 
(00.0%) 


2S. 


Any effect in what you do, 
think , feel , e tc« ? 


Yed 

No 


9 
2 


(81.8%) 
(18.2%) 


26. 


(A) Average time spent 
on course? 


He an 
N 


212.4 

7 


Minutes 




(B) In comparison with 
other courses? 


More 
Same 
Less 


1 
1 
4 


(16.7%) 
(16.7%) 
(6(5.7%) 


SI. 


Should course be taught 
again at Erindale? 


Yes 
No 


10(100. Ot) 
0 (00. ot) 


S2. 


Should TV format be taught? 


Yes^ 
No 


3 
7 


(30.0%) 
(70.0%) 


S3. 


Same format, but without TV? 


Yes** 
No 


9 
1 


(90.0%) 
(10.0%) 
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Items are abbreviated and slightly rearranged for better 
tabular presentation. 

'tvo of those responding "^yes" proposed extensive modifica- 
tions . 
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most of the conpoiiants of the course they were asked about, 
as indicated by the fact that the mean scores for the worth 
of the textbook, TV lectures, lecture notes, audio tapes, 
and puppet (a part of the TV programs) were all 2.44 or 
less. Finally, two ccnoponents do 'buck the trend*. The 
worth of the OECA worksh<^ was given a mean score of 3.75 
and the effectiveness of the illustrative materials used in 
the TV lectures was rated at 3.90. 

There appears to be a contradiction in the data. Com- 
munications lOOE was very favourably received, and yet most 
of |.ts components were not favourably received.' It seems 
unreasonable to believe that th^ course as a whole could be 
so [re 11 liked when the only worthwhile con^onenta were the 
"^Eck workshop that was attended by only four of the eleven 
students (presumably, since N«4 for that item) and the 
illustrative materials of the TV programs. This contra- 
diction can be explained, however, by the presence of 
course components that were not asked about in the Final 
Questionnaire. As indicated in the Introduction, Com- 
munications lOOE included conqponents other than those asked 
about on the Questionnaire. The popularity of these was 
great and probably accounts for the generally favourable 
reception of the course.^ Which of the course's components 
^ were favourably received will becoms clear when the re- 
sults of the open-ended questions and of the interviews are 
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considered. 

The remaining results listed in Table 1 (items 10, 19, 
20, 25, 26) require, lit^o explanation since in all but one 
case (item 2$A) the actual response alternatives «uid fre- 
quencies with which each was chosen are indicated. Thus, it 
can be noted that the amount of material covered in the lec- 
tures, the use (amount) of "academic* language, and the time 
the professor was on camera tended to be perceived as too 
»uch rather than too little, although in all three cases memy ^ 
students replied about right . These results support the 
conclusion that something was less than ideal 2Ut»out the TV 
lectures in the opinion of many students and suggest that 
the lectures were 'too much' with respect to both amount of 
material and its technical nature. 

The responses to item 26A indicate that the mean time 
spent by students on the course was about 3.5 hours. (The 
median time, however, was less than three hours.) This was 
felt to be less than the time spent on other courses. Since 
there was a ttfo hour class meeting scheduled during most 
weeks, the mean number of non-class hours is presumably about 
1.5. 

The final three items of Table 1 are the three yes-no 
supplemental questions (SI, S2, S3). The responses to these 
questions indicate that most students feel Communications lOOE 
should be taught again at Erindale, but that the "television 
format" should not be employed. Once again, the results point 
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to the students' antipathy towards the TV component. 

The verbatim responses to the open-ended questions 
(items 25, 27-29, S4, S5) are presented in Table 2. (In 
this table the several reactions of a single student to 
a particular item are grouped together on iuccessive lines, 
while reactions from different students are separated by 
several lines.) Table 1 indicated that nine of the eleven 
students felt the course had affected them (item 25) . The 
elaborations listed in Table 2 indicate that the perceived 
effects iiiclude increased exposure to ideas, critical ability, 
facts, insight, understanding, and communication ability. 
These and the other effects listed suggest that different 
students have different ideas about how the course affected 
them. 

Items 27-29, S4, and S5 all deal, in one way or another, 
with what is right and/or wrong about Communications 10 OE. 
In general, the students liked or wanted more of the following: 
trips, guest lecturers, discussions, informality, freedom, 

* 

reading lists, workshop, some specific topics, some specific 
TV programs, class projects, and practical technical exper- 
ience. The students did not like or wanted less or the fol- 
lowing: the TV programs (especially the puppet and the 
material on the senses) , the "handbook" (program notes?) , and 
the relative lack of structure. 

It is very clear on the basis of the Final Questionnaire 
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TABX«E 2 

Verbatim responses to open ended questions 
on Final Questionnaire 



25 « Beyond providing course content, has Arts 100 had any 
effect on what you do, think, believe, etc.? Please 
elaborate • 



^More exposed to different Acets of communication to new 
Ideas. ^ 



-Hade me more critical of the various media. 



could explore topics I wanted to and hence learned about 
advertising, Canadian Content Regulation, Radio Broadcasting, 
t Camera work better. 



-Giiln Insight, new perspective 

-Better understanding <>f oneself 

-Enabled me to communicate more effectively 



-I have learned to communicate yet cannot really express my- 
self properly, at the moment. 

-It made me realise that the media exist* 

-Profound effect. It allowed me to take **part" In a course. 

-Educated me regarding the ad Industry. 
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TABLE 2 - Cont'd 



27« The most valuable aspects of the course were*.. 



•Tripsf guest lecturers d discussions with them after 
class. 



-Some of the TV programs; discussions. 



*The informality 

-The closeaess of the prof. 

-*The diversity of all of our interests blended 
-W* were free to delve into topics of our own choice 
at anytime right down to the final exam 



-Guest speakers « 
-Flexibility of course content in tutorial period 
-Tutorial leader was understanding 
-tfas interested in exploring our areas of interest 
-Gave us opportunity to choose topics for discussion 



-Reading lists and references 

-'The most valuable aspects of the course were the proRram 
workshop and guest speakers. The course was extremely 
informational in respect to current problems in the media 
(effects of advertising, CATC disputes, how the media are 
manipulated - both good i bad.) 

-The programs on hypnosis and what is good and bad about 
the media. 

\ 

-Advertising studies 
-Guest speakers 
-Cultural aspects 



-Sparked interest in new topics - subliminal, coiranunication, 
brainwashing etc. 
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TABLE 2 - Cont'd 



28. The least valuable aspects of the course were... 



-Video Tapes 



-Puppet 



-More organisation in the seminars 

-we should have been able to prepare more for many of the 
seminars (by knowing the topic to be discussed). 



-TV format was unappealing to me 



-The handbocdc for the course 



-The TV programs. Somehow TV programs are intimidating. 
There is no give ft take - just taka^ Some areas covered 
in the program, specifically the program on the senses 
were interesting biologically but we were concerned with 
communication - not that it was completely irrelevant 
but just overdone. 



The first 5 programs were of little use. 



-TV lectures % 

i 

I 

"Technical TV programs on mechanics of seeing, hearing etc. 



115 



-15- 

TABLE 2 - Cont^d 



29. How would you like to see the course changed? 



-More en^hasis on actual techniques of film« VTR 
•How to assemble a film to get the effect you want 
-How do film-^makers communicate - what difference 

does the editing i of the sound background make to the 

meaning of the film 



-Take out the pi;^peti treat university students like 
university students perhaps more research work 



-More handling of cameras etc. 

-I would like to see the TV programs eliminated and more 
time spent on things like workshops such as the one at 
Scarborough College 



-Drop the TV 

-More class projects eg. get advertising men & men in all 
other areas of communication to .talk 



-A more free format, minus TV lectures 



• 
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TABLi: 2 - Cont'd 



V 

S4. What other reconunendations would you have for next year? 



-More practical knowledge, plus more knowledge of the phil, 
of conununicatlons - a closer look at techniques. 



-Less difficult assignments on TV; more research. 



•None 

-Keep it as informal as it was this year with the emphasis 
on individual incentive. 

\ 

-More technical work - ecj, workshops 

-exposure to radio ft films a bit more * 

-More field trips - to«.radio stations, CBC, newspapers 

-I recommend a complete revamping of the course. It should 
include a variety of topics such as - Mass Itedia (theoretical 
study), Audio-Visual Techniques (practical study), Advertising 
practical), & my most enjoyable part of the year> Marketing 
St Fhoto Journalism. 

-A more free format giving professor more choice of material 
to be covered. 



•More funds 
•Seminars 

•Same small classes 



•Would recommend more practical experience in use of audio- 
visual equipment 
•More f ieldtrips 
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TABLE 2 - Cont'd 



S5. What other comments do you have regarding Communica- 
tions lOOE this year? 



-Could have wished for a bit more practical knowledge, but 
in general very interesting. Exposure to many facets - 
advertising, hypnotism, theatre, movies, video as movies etc. 

-Worthwhile but perhaps needs more structure 

-Workshop at Scarborough College - extremely interesting 
lectures • were informative 6 interesting 

-Informal atmospheze was very nice to work in 

-TV programs - some were interesting but obviously one- 
sided mechanical type of situation 

-I enjoyed the course 

-Good 

-Stimulating lectures ^ 

-Interesting guests 

-High level of sophistication 

-Perhaps students should be a little more sure what was 
expected of them 

if 

-Interesting 

-Liked open discussions 

-There seemed to be a lack of funds for anything we wanted 
to do. 

-Could be more structural 

-The variety of guest speakers was excellent 
-Enabled us to examine many aspects of the communications 
media 

-Well chosen 6 informative speakers 

-choice of topics covered was flexible - this was appropriate 
because students had the opportunity to explore their interests 
& yet learn new aspects of communication. 

-As an idea - it was great. I thoroughly enjoyed attending your 
classes and hope that you will go into the teaching field. It 
was so refreshing to see someone who doesn't use regimentation 
in lectures. I enjoyed your guest speakers and particularly 
the advertising man. The outings to the theatre were well 11 R 
studied and of great importance to cultural formation. The TV ^" 
O . lectures were - plain & simple. I feel that video-tape lectures 
EHJC are too inanimate which results in the student's disinterest in 
mBMsam them. YOU can*t ask a taped professor a question. 



that most of the components of Arts 100 were not regarded 
as worthwhile* They certainly did not contribute greatly 
to the positive reception of the course as a whole. Of the 
regular (Arts 100) course components, only the workshop and 
some of the TV programs were well Liked. Some of the TV 
programs and techniques were disliked enough for the stu- 
dents to suggest major changes in them. Presumably, the 
other components that were used were not disliked, although 
they w< re not considered to be valuable. The non-Arts 100 
components^ of Communications lOOE that were liked include 
trips, guests, discussions, technical experience, projects, * 
and some specific topics. The favourable reception of 
these components explains the discrepancy between the over- 
all positive reaction to Communications lOOE and the negative 
reactions to so many of the Arts 100 components. 

Interviews . The answers to the interview questions as 
recorded by the author are found in Table 3. It is important 
to remember that only seven of the students were interviewed, 
and therefore the results may be based on an unrepresentative 
sample. Each line beginning with a hyphen (-) indicates the 
answer of a different student. Item 1 requires little com- 
ment except to remind the reader that the information avail- 
able to the prospective student may have been limited. The 
initial expectations as listed in item 2 tend to revolve 
around two major themes: media and experience with equipment 
'Officially*, media was only part of the stibject matter of 



-19- 



the course; also, equipment experience was a very small part 
of the course. Thus<, the initial expectations were discre- 
pant with respect to the course as originally conceived to 
the extent that the course was to contain many topics. and 
experiences that the students were not expecting (or, rather, 
which they did not recall expecting when questioned in May)/ 
The replies to item 3 indicate that in spite of whatever dis- 
crepancies may have existed between initial e:<pectations and 
rcalilv, a good number of the students (about half of those 
interviewed) felt that their expectations had been fulfilled. 

When asked about what they got out of the course the 
students mentioned a variety of skills and topics which 
practically defy generalisation. They ranged from philosophy 
of communication to technical information to experience 
(item 4). When asked about what the course consisted of, how- 
ever, there was relatively great agreement as might be ex- 
pected given a factual question (item 5). It consisted of 
TV, trips (including trips to see plays and movies), speakers, 
discussion, projects (all of which were mentioned by a number 
of students) , and a few other components such as an exam, 
program notes, equipment, labs, and reading list (each of 
which was mentioned by only one of the seven students inter- 
viewed) . It is interesting to note that certain components 
of the course were not mentioned at all (e.g., the text) al- 
though other evidence (the Final Questionnaire) indicates 
they were known to at least some of the students. In a few 
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TABLE 3 

verbatim responses to interview questions 



!• How did you hear about Arts 100? 

-was going to take Communications 220 and Com- 
munications 100 was recoirmended 
-bulletin board 

^registrar (wanted another communications) 

-a friend I bulletin board 

-poster 

-friend; notices 

--bulletin board} people who liked it 



2. What did you initially expect to get from the 
course? 

-media, influences, equipment, hands o|i exper- 
ience 

-technically, TV, equipment m 

-other course was \ course 

-something different; cameras 

-study of media 6 its effects on people 

-communications - media, technique, effects, a 

little philosophy 
-broader view of communication topics ^ adver- 
tising, McLuhan , practical 

3. Were these initial expectations fulfilled? 

-yes, workshop at Scarborough 

-no 

-? 

-yes, but senses screwed it up 
-yes, own work 

7-nil for Arts 100? (not in depth) 
-yes 



4. What did you get out of the course? 

-experience, useful information about commercials, 
CRTC etc. 

-plays, cable TV, basic introduction 
-technical information, subliminal media, McLuhan, 
broad range 

-different media, movies plays etc., workshop, 

advertising, bad TV 
-just talking, visitors 

-broader view of philosophy of communication, where 

. ^ ^ 191 
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to go for Information about communication 
-practical stuff (advertif ing, marketing), speakers 



5. What, actually, did the course consist of? 

-TV, guests^ trips, discussion 

**TV4^ speakers , plays , movies 

-TV, "HtMakers, exam, projects 

-projects, equipment 

-TV, discussion, visitors, movies 

-seminar, labs, program notes, list of tapes, 

class discussion, TV, speakers, trips, project, 

reading liBt 
-TV, speakers, plays 



C). (I know this has been asked before, bat*..) 
How %iould you change the course? 

-No TV 

-No TV, too much like Sesame Street, too slow (boring) 
-TV worst, couldn't hold attention, too many technical 

terms, better when course wasn't on TV 
o-No TV k discussion of TV, do your own thing 
-Wouldn't, but more selective on TV side 
-TV: More clear cut, no crammed information, no frog, 

better organisation, slow down the superfluous, too 

single, distracting but interesting, more information 

less image 

-No TVt too intangible, more personal contact, no 
senses, no frog, you can't ask a TV a question 
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cases, the author pursued the matter by specifically asking 
about the audio tapes. In these cases, the students usually 
added i:hat they had not used them. Again the data led to 
the conclusion that a number of the course coiiqponents (audio 
tapes, books, amd notes) were not of value to many of the 
students; these components were sixnply ignored by most stu* 
d€^Ats wheA the coiiq;>c»sitioA of the course was asked about. 

The responses to item 6, about changes, tended to stress, 
even m« re than did the similar items on the Questionnaire 
(Moms 29 and S4) , that the TV coirponent should be in^roved 
or eliminated. There was considerable variety in the specifics, 
and in some cases there were contradictions — one student would 
like the TV programs slowed down, while another thought they were 
too slow* But the students interviewed are unanimous in feel- 
ing that the TV programs should be changed in some way. The 
students do not ignore the TV component; they advocate specific 
changes in it. 

Mass Media Survey . Table 4 gives the results of the Mass 
Media Survey. The responses to item 1 indicate that in terms 
of time spent with the media as sources of information, the 
students averaged 7.05 hours with television, 11.83 hours 
with radio, 3.45 hours with newspapers, and so on. The order* 
ing of the media in these terms, in descending order, was radio, 
television, books, newspapers, magazines, and movies. 

The responses to item 2 indicate that the students tend 
to perceive radio and books as the most accurate sources of 
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information, to perceive movies as the most biased, and to 
believe that the specific material they watch, listen to, or 
read ( somewhat more accurate than media supplied information 
in general, with the greatest discrepancy being between the 
television they watch and television in general. 

The responses to items 3 and 4 are hard to interpret 
wlthput considering the students* elaborations, except per- 
haps by noting that the students' use and opinions of teJ.e- 
visi(>^ ind newspapers have changed more (in their judgment) 

.*ju have their use and opinions of the other media. Unfor- 
tunately, the recorded elaborations (which are not preserited) 
are sparse and not always relevant, but if trends can be 
based on t^wo or three comments per medium then a few can be 
discerned. One is that overall there seems to be more men- 
tion of increase in media use than decrease. However, among 
the most 'active* media television decreases in use, while 
newspapers increase. Some of the increases are due to the 
students' having more time to read •'now that school is over." 
A second trend, probably the most important regarding the 
course and the media, concerns the responses to item 4. Most 
of the elaborations^ for all the media suggest an increase in 
caution towards the medium in question as a source of informa- 
tion. 
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TABLE 4 

Results of. the Mass Media Survey 



Oucst ion 



Results 



On the. average how many hours a week 
c|o you spend on each of the following 
media as a source of information ? 
Please elaborate. 



(a) 


TV 


Mean 


7.05 






N 


10 


'b) 


Radio 


Mean 


il.83 






N 


9 


c) 


Newspapers 


Mean 


3.45 






N 


10 


•d) 


Magazines 


Mean 


2.43 




N 


8 


(e) 


Books 


Mean 


7.78 






N 


7 


(f) 


Movies (not on TV) 


Mean 


2.08 






N 


6 



Below please indicate your opinion 
regarding how accurate as sources of 
information the various media are. 
Do this separately for: (1) the 
media in general, and (2) your choice 
from each of them. 



(a) TV: 

(b) Radio: 

(c) Newspapers: 

(d) Magasines: 

(e) Books: 

if) Movies (not on TV) 
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In general 
In general 
In general 
In general 
In general 
In general 
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Mean 
N 

Mean 
N 

Mean 
N 

Mean 
N 

Mean 
N 

Mean 

N 



2.27 
11 

2.70 
10 

2.09 
11 

2.60 
10 

2.72 
10 

1.50 
8 



What I watch 

What I listen 
to 

What I read 
What I read^ 
What I read 
What I watch 



Mean 2.66 
N 9 

Mean 3.00 
N 9 

Mean 2.22 
N 9 

Mean 2.66 
N .9 

Mean 2.80 
N 9 

Mean 1.57 
N 7 
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Results 



Question 



3. Has there been any change in 
your use of these media in 
recent months? Please elaborate. 

(a) TV Yes 5 (45.41) 

No 6 (54.5%) 

(b) Radio Yes 2 (20.0%) 

No 8 (80.0%) 

(c) Newspapers Yes 5 (50.0%) 

^ No 5 (50.0%) 

(d) Magazines Yes 2 (IH.1%) 

No 9 (81.8%) 

(e) Books Yes 4 (36. 3%) 

No 7 (63.6%) 

(f) Movies (not on TV) Yes 2 (20.0%) 

No 8 (80.0%) 



4. Has there been any change in 
your opinions of or attitudes 
toward these meciia in recent 
months? 

(a) TV 

(b) Radio 

(c) Newspapers 

(d) Magazines 

(e) Books. 

(f) Movies (not on TV) 



Yes 


8 


172.7%) 


No 


3 


(2'. 2%) 


Yes 


4 


(36. 3%) 


Ne 


7 


(63.6%) 


Yes 


6 


(54.5%) 


No 


5 


(45.4%) 


Yes 


3 


(27.2%) 


No 


8 


(72.7%) 


Yes 


1 


(09.0%) 


No 


10 


(90.9%) 


Yes 


1 


(09.0%) 


No 


10 


(90.9%) 
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CONCLUSION S 

Tiends can be digcerned in the data leadtncj to the 
following conclusions: Most of the students expected a 
course on media and media techniques. Furthermore, most 
of those interviewed had their expectations fulfilled. 

The overall rating of the course was favourable, but 
most of the con^onents of the course that led to this fa- 
vour were components that were not part of TVrns 100. Thcise 
well- received non-Arts 100 components include class trips, 
guest speakers, and class discussions. Certaxn othci aspects 
of the course were c Iso weJl- liked, such as the informaJ ty 
with which it was ccnducte'l, and some of the ipocific topics. 

Many of the Arts 100 components were not considered 
valuable by the Erindale students. These included the text 
the audio tapes, and the lecture notes. The VV programs in 
(|eneral and certain specific aspects of them (the puppet, 
the lectures themselves, some specific topics, the technical 
language) evoked mary recommendations for change. One as- 
pect of the TV progiams, tiie illustrative material, was 
considered to be valuable. Also, one Arts 100 component was 
given a clearly positive rating — the OECA workshop. 

A final relevant trend that can be detected is that to- 
wards more caution with respect to the media. That is, the 
students who claim their opinions of or attitudes toward the 
media have changed in recent months usually claim that this 
change is in the direction of greater caution^ 
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Al'PENDIX 

Final Questionnaire 
Mass Media Survey 
Interview Questions 
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Project Code Number: 



ARTS iOO EVALUATION PROJECT 
Final Questionnaire 

} 

-^- student status: full-time — . . * 

^ part-time de^l'ee 
non-degree part-time 

Old you apply to the University primarily to take Arts 100? yes 

; no 

Were you admitted as a ••mature" student (did not meet the University's 
regular grade 13 admission requirements)? yes; no 

Please answer questions 1-22 by circling the letter of the alternative 
that best answers each question. Place any comments about your answers 
in the spaces to the right of the alternatives. If an item asks you to 
evaluate part of the course which you haven't done (e.q-, the OECA 
workshop) or materials you haven't used (e.g., the audio tapes), ignore 
that item. 



1. To what extent has Arts 100 met your personal expectations? 



(a) almost completely 

(b) to a considerable extent 

(c) somewhat 

(d) a little 

(e) not at all 



Comments . 



2« To what extent has Arts 100 met the objectives stated in its brochure? 



( a ) a Imos t comple te ly 
OMIT THIS (b) to a considerable extent 
QUESTION (c) somewhat 
(d) a little 

(e) not at all 



Comments 



3. How would you rate Arts 100 overall? 



(a) excellent 

(b) very good 

(c) good 

(d) fair , 

(e) poor 



Comments . 



4. Would you reconnend to a ^friend 

(a) yes, recommend it highly 

(b) yes 

(c) don't know 

(d) no 

(e) definitely not 



that he or she take Arts 100? 
! Comments . . . 
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5« How interesting did you find the course? 

(a) extremely^ interesting {Comments 

(b) qiuite interesting 

(c) interesting 

(d) not very interesting 

(e) boring 

6. Itow would you rate Arts 100 in comparison with other university courses? 

(a) one of the best i Comments ... 

(b) better than most 

(c) about average 

(d) not as good as most 
(•) one of the poorest 

I . Do you feel that the time devoted to Arts 100 was well spentr?^ 

(a) always { Coimnents • • • 

(b) usually * / *; 

(c) sometimes 

(d) seldom 

(e) never 

8. How intellectually stimulating did you find the course? 

(a) highly ; Comments 

(b) guite 

(c) somewhat 

(d) slightly 

(e) not at all 

How understandable did you find the TV lectures? 

(a) extremely understandable i Comments ... 

(b) quite understandable 

(c ) understandable 

(d) not very understandable 

(e) not at all understandable 

10. How do you feel about the amount of material covered in the lectures? 

(a) too much ! Comments 

(b) just about right 

(c) too little 

II. How worthwhile did you find the book |||The New Literacy*"? 

Comments • • • 



(a) extremely worthwhile 

(b) quite worthwhile 

(c) worthwhile 

(d) of little worth 

(e) a waste of time 



ERLC 



130 



-30- 




12. How worthwhile did you find the monthly seminars? 

(a) extremely worthwhile I Comments 

OMIT THIS quite worthwhile 

" Iftflfl ' " worthwhile 

(d) of little worth 

(e) a was t^ of time 

U. How worthwhile did you find the assignments? 

m mu,« i** extremely worthwhile i Comments ... 
S-SSS (b) quite worthwhile 
TIQW (c) worthwhile 

(d) of little worth 

(e) a waste of time 

14. How worthwhile did you find the T.V. lectures? 

(a) extremely worthwhile ! Comments ■ ■ - 

(b) quite worthwhile 

(c) worthwhile 

(d) of little worth 

(e) a waste of time 

15. How worthwhile did you find the notes on the lectures? 

(a) extremely worthwhile | Comments ... 

(b) quite worthwhile 

(c) worthwhile 

(d) of little worth 

(e) a waste of time 

Ui. How worthwhile did you find the audio tapes? 

(a) extremely worthwhile i Commenti 

(b) quite worthwhile 

(c) worthwhile 

(d) of little worth 

(e) a waste of time 

17. How worthwhile did you find the OECA TV workshop? 

(a) extrwnely worthwhile ! Comments . . . 

(b) quite worthwhile 

(c) worthwhile 

(d) of little worth 

(e) a waste of time 

18. What effect do you think the use of the puppet had on the TV lectures? 



(a) considerably aided 

(b) somewhat aided | 

(c) neither aided nor detracted 

(d) somewhat detracted } 

(e) considerably detracted > 



I Coimnents . . . 
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19. How do you feel about Professor Gordon's use of ''academic'* or 
technical language? 



(a) too nuch'of it 

(b) just about right 

(c) too little of it 



Comnents 



20. How do you feel about the amount of time Prof. Gordon was on camera? 

(a) too much ! comments 

(b) just about right 

(c) too little 

\ 

21. How effiictive did you find the illustrative materials used in 
the TV lectures? 

(a) considerably aided i Comments • • • 

(b) s^omewhat aided { 

(c) neither aided nor detracted 

(d) somewhat detracted i 

(e) considerably detracted | 

22. How do you feel the fox mat of Arts 100 compares with **standard* 
university course formats? 

(a) much better i Comitients 

(b) better 

(c) about as good 

(d) not as good 

(e) much worse 

23 a) • Did the **hot line*^ satisfactorily meet your needs? 
yes 



OMIT THIS no 

gOESTIOir " didn't use 

If you checked ''no" or "didn't use", please indicate why. 



(b) • What other arrangements would you like to see for receiving your 
comments, providing you with help or feedback, etc.? 



24. Did you find that secondary reading materials were accessible enough 

IT THIS for your needs? V*®^ — 

fTfoSr 

Please elaborate. • 
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25, lioyond providing course content, has Arts 100 had any effect on what 
you do, think, believe, etc.? yes; no 

Please elaborate • 



26. Roughly how much time per week did you spend on Arts 100 (Including 
TV viewing, reading, preparing assignments, etcj? 

Average time spent per week » hours. 

In comparison with other courses Arts 100 took: 

more time 

about the same amount of time 

less time 



27, The most valuable aspects of the courje were 



28. The least valuable aspects of the course were 



2"), How would you like to see the course changed? 
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SUPPLEMENTAL QUESTIONS FROM THE FINAL QUESTIONNAIRE 



Sl« Would you recommend that Communications lOOE be 
taught at Erlndale next year? 



S2. Should the TV format be taught? 



S3. Should a course of the same format # but not using 
the Arts 100 Waterloo TV format be used? 



Si. What other reconmendatlons would you have for next 
year? 



S5« What other comments do you have regarding Communica- 
tions lOOE this year? 



13 \ 



•34- 



MASS MEDIA SURVEY 



1 • On thm wmtaqm how many hours a woak do you spand on aach of tha 
fpllovin? madia *aa a aourca of information ? 



(a) TV 

(b) Radio 

(c) Nawspapara 
^(d> Magaiinaa 

(a) Books 

it) Moviaa (not on TV) 
Othart 



Plaase alaborata 



2. 4a low plaasti indicata yatr opinions ra^arding how accurata as sourcas 

of information tha various madia ara« I>o this saparataly fori (1) tha 
ncdia in geaaral, and (2' your choica from aach of tham. 

Quite RaasonabLy Somawhat Quita 

Accurata Accurata Biasad Biasad 

In ganaral ____ 

What X watch ..^^^^ 

In ganaral 

What I listen to 



in general 
What I read 



In general 
What I read 



In general 
What I read 



Movies (not on TV) : In general 

What I watch 



Other: 



Kadio: 
Newspapers : 
Magazines: 
Books: 



Comnients: 
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3. H«s th«re b«en any changs in your us* of these media in recent months? 

Yes No Please elaborate: 

(a) TV 

(b) Radla 

(c) Newspapers 

(d) Naga sines 

(e) Books 

(f) Movies (not on TVI 

Other: 



4, Has there h-sen any changti in your* opinions of or attitudes toi;ard 
these media in recent mouths? — — _ 

- Yes No Plrase elaborate: 

(a) TV 

(b) Radio _f 

(c) Newspapers ^ 

(d) Magazines 

(e) Books ^ 

(f) Movies (not on TV) 

Other: 



Please write any comments about this questionnaire below. Additional 
comments about the questionnaire or Arts 100 can be written on the back 
of this page. 
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INTERVIEW QUESTIONS 



1. How did you hear about Arts 100? 



2. What did you initially expect to get from the 
course? 



3. Were theses initial expectations fulfilled? 



^. What did you get out of the course? 



5. What, acti^ally, did the course consist of? 



6. (I know this has been asked before, but...) 
How would you change the course? 
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